Jul 24 09:30:13 devstack cinder-volume[77310]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 24 09:30:13 devstack cinder-volume[77310]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 24 09:30:13 devstack cinder-volume[77310]: we strongly recommend against using it for new projects. Jul 24 09:30:13 devstack cinder-volume[77310]: If you are already using Eventlet, we recommend migrating to a different Jul 24 09:30:13 devstack cinder-volume[77310]: framework. For more detail see Jul 24 09:30:13 devstack cinder-volume[77310]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 24 09:30:13 devstack cinder-volume[77310]: import eventlet # noqa Jul 24 09:30:16 devstack cinder-volume[77310]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 09:30:16 devstack cinder-volume[77310]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 09:30:16 devstack cinder-volume[77310]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 09:30:17 devstack cinder-volume[77310]: INFO dbcounter [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Registered counter for database cinder Jul 24 09:30:17 devstack cinder-volume[77310]: DEBUG oslo_db.sqlalchemy.engines [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77310) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 09:30:17 devstack cinder-volume[77310]: DEBUG dbcounter [-] [77310] Writer thread running {{(pid=77310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 09:30:17 devstack cinder-volume[77310]: INFO cinder.rpc [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 24 09:30:17 devstack cinder-volume[77310]: INFO cinder.rpc [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 24 09:30:17 devstack cinder-volume[77310]: DEBUG oslo_db.sqlalchemy.engines [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77310) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 09:30:17 devstack cinder-volume[77310]: INFO cinder.volume.manager [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Determined volume DB was empty at startup. Jul 24 09:30:17 devstack cinder-volume[77310]: DEBUG cinder.volume.manager [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77310) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 24 09:30:17 devstack cinder-volume[77310]: INFO cinder.volume.manager [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 24 09:30:17 devstack cinder-volume[77310]: WARNING stevedore.named [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 24 09:30:17 devstack cinder-volume[77310]: WARNING castellan.key_manager [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 09:30:17 devstack cinder-volume[77310]: WARNING cinder.keymgr.conf_key_mgr [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 09:30:17 devstack cinder-volume[77310]: DEBUG cinder.volume.drivers.lvm [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77310) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 24 09:30:17 devstack cinder-volume[77310]: DEBUG oslo_concurrency.processutils [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_concurrency.processutils [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] CMD "cinder-rtstool verify" returned: 0 in 0.407s {{(pid=77310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_db.sqlalchemy.engines [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77310) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 09:30:18 devstack cinder-volume[77310]: INFO cinder.rpc [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 24 09:30:18 devstack cinder-volume[77310]: INFO cinder.rpc [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 24 09:30:18 devstack cinder-volume[77310]: WARNING stevedore.named [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 24 09:30:18 devstack cinder-volume[77310]: WARNING castellan.key_manager [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 09:30:18 devstack cinder-volume[77310]: INFO cinder.volume.manager [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_db.sqlalchemy.engines [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77310) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 09:30:18 devstack cinder-volume[77310]: INFO oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Starting 1 workers Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Started child 77458 {{(pid=77310) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Full set of CONF: {{(pid=77310) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] ******************************************************************************** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Configuration options gathered from: {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] ================================================================================ {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] allow_availability_zone_fallback = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] allow_compression_on_image_upload = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77458]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] allowed_direct_url_schemes = [] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] api_rate_limit = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] auth_strategy = keystone {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] az_cache_duration = 3600 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_availability_zone = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_host = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_name = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_stats_polling_interval = 60 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backup_api_class = cinder.backup.api.API {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backup_name_template = backup-%s {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backup_use_same_host = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backup_use_temp_snapshot = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] chap_password = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] chap_username = {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cinder_internal_tenant_project_id = b49212d4c5534b11ad9d22f78bd65e81 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cinder_internal_tenant_user_id = 08f64fbbf3364618a2d8f17a4d0c8a4e {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cloned_volume_same_az = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cluster = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] compression_format = gzip {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] compute_api_class = cinder.compute.nova.API {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] config_dir = [] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] config_source = [] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] control_exchange = openstack {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] debug = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] default_availability_zone = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] default_group_type = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] default_volume_type = lvmdriver-1 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] disk_geometry = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] driver_client_cert = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] driver_client_cert_key = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] driver_data_namespace = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] driver_ssl_cert_path = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] driver_ssl_cert_verify = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] driver_use_ssl = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] enable_force_upload = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] enable_new_services = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] enable_unsupported_driver = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] enforce_multipath_for_image_xfer = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] filter_function = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] glance_api_insecure = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] glance_api_servers = ['http://192.168.122.135/image'] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] glance_api_ssl_compression = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] glance_ca_certificates_file = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] glance_catalog_info = image:glance:publicURL {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] glance_certfile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] glance_keyfile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] glance_num_retries = 3 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] glance_request_timeout = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] goodness_function = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] graceful_shutdown_timeout = 5 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] group_api_class = cinder.group.api.API {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] host = devstack {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] image_compress_on_upload = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] image_conversion_address_space_limit = 1 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] image_conversion_cpu_limit = 60 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] image_conversion_disable = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] image_upload_use_cinder_backend = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] image_upload_use_internal_tenant = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] image_volume_cache_enabled = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] image_volume_cache_max_count = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] image_volume_cache_max_size_gb = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] init_host_max_objects_retrieval = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] instance_format = [instance: %(uuid)s] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] iscsi_target_flags = {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] iscsi_write_cache = on {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] iser_helper = tgtadm {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] iser_ip_address = 192.168.122.135 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] iser_port = 3260 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] log_color = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] log_config_append = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] log_dir = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] log_file = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] log_options = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] log_rotate_interval = 1 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] log_rotate_interval_type = days {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] log_rotation_type = none {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] max_age = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] max_logfile_count = 30 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] max_logfile_size_mb = 200 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] max_over_subscription_ratio = 20.0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] message_reap_interval = 86400 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] message_ttl = 2592000 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] migration_create_volume_timeout_secs = 300 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] monkey_patch = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] monkey_patch_modules = [] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] my_ip = 192.168.122.135 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] no_snapshot_gb_quota = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] num_iser_scan_tries = 3 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] num_shell_tries = 3 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] num_volume_device_scan_tries = 3 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] nvmeof_conn_info_version = 1 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] nvmet_ns_id = 10 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] nvmet_port_id = 1 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] osapi_max_limit = 1000 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] osapi_volume_ext_list = [] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] osapi_volume_listen_port = 8776 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] osapi_volume_use_ssl = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] osapi_volume_workers = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] per_volume_size_limit = -1 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] periodic_fuzzy_delay = 60 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] periodic_interval = 60 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] public_endpoint = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] publish_errors = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] quota_backup_gigabytes = 1000 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] quota_backups = 10 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] quota_gigabytes = 1000 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] quota_groups = 10 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] quota_snapshots = 10 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] quota_volumes = 10 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77458]: INFO cinder.volume.manager [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 24 09:30:18 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] rate_limit_burst = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] rate_limit_except_level = CRITICAL {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] rate_limit_interval = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] reinit_driver_count = 3 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] replication_device = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] report_discard_supported = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] report_interval = 120 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] reservation_clean_interval = 86400 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] reservation_expire = 86400 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] reserved_image_namespaces = [] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] reserved_percentage = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] rpc_response_timeout = 120 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] run_external_periodic_tasks = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] scst_target_driver = iscsi {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] scst_target_iqn_name = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] service_down_time = 720 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] shell_completion = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] snapshot_name_template = snapshot-%s {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] snapshot_same_host = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] split_loggers = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] state_path = /opt/stack/data/cinder {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] storage_availability_zone = nova {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] storage_protocol = iSCSI {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] syslog_log_facility = LOG_USER {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] target_helper = lioadm {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] target_ip_address = 192.168.122.135 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] target_port = 3260 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] target_protocol = iscsi {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] target_secondary_ip_addresses = [] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] trace_flags = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] transport_url = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] until_refresh = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] use_chap_auth = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] use_default_quota_class = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] use_journal = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] use_json = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] use_multipath_for_image_xfer = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] use_stderr = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] use_syslog = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] verify_glance_signatures = enabled {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] volume_api_class = cinder.volume.api.API {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] volume_backend_name = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] volume_clear = zero {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] volume_clear_ionice = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] volume_clear_size = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] volume_copy_bps_limit = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] volume_dd_blocksize = 1M {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] volume_name_template = volume-%s {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] volume_service_inithost_offload = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] volume_usage_audit_period = month {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] zoning_mode = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_concurrency.disable_process_locking = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:18 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.auth_section = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.auth_type = password {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.auth_version = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.cache = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.certfile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.include_service_catalog = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.insecure = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.interface = public {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.keyfile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.memcache_password = {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.memcache_username = {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.region_name = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.service_type = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.backend = dogpile.cache.null {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.backend_argument = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.backend_expiration_time = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.config_prefix = cache.oslo {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.debug_cache_backend = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.enable_retry_client = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.enable_socket_keepalive = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.enabled = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.expiration_time = 600 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.hashclient_retry_attempts = 2 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.memcache_dead_retry = 300 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.memcache_pool_maxsize = 10 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.memcache_sasl_enabled = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.password = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.proxies = [] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.redis_db = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.redis_server = localhost:6379 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.retry_attempts = 2 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.retry_delay = 0.0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.socket_keepalive_count = 1 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.socket_keepalive_idle = 1 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.socket_keepalive_interval = 1 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.socket_timeout = 1.0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.tls_allowed_ciphers = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.tls_cafile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.tls_certfile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.tls_enabled = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.tls_keyfile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cache.username = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] coordination.backend_url = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.asyncio_connection = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.asyncio_slave_connection = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.backend = sqlalchemy {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.connection = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.connection_debug = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.connection_parameters = {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack sudo[77462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.connection_recycle_time = 3600 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack sudo[77462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.connection_trace = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.db_inc_retry_interval = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.db_max_retries = 20 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.db_max_retry_interval = 10 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.db_retry_interval = 1 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.max_overflow = 50 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.max_pool_size = 5 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.max_retries = 10 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.mysql_wsrep_sync_wait = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.pool_timeout = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.retry_interval = 10 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.slave_connection = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.sqlite_synchronous = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.synchronous_reader = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] database.use_db_reconnect = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] profiler.connection_string = messaging:// {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] profiler.enabled = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] profiler.es_doc_type = notification {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] profiler.es_scroll_size = 10000 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] profiler.es_scroll_time = 2m {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] profiler.filter_error_trace = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] profiler.hmac_keys = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] profiler.sentinel_service_name = mymaster {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] profiler.socket_timeout = 0.1 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] profiler.trace_requests = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] profiler.trace_sqlalchemy = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] profiler_jaeger.process_tags = {} {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] profiler_jaeger.service_name_prefix = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] profiler_otlp.service_name_prefix = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_policy.enforce_new_defaults = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_policy.policy_default_rule = default {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_policy.policy_file = policy.yaml {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] privsep_osbrick.group = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] privsep_osbrick.helper_command = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] privsep_osbrick.user = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cinder_sys_admin.group = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cinder_sys_admin.helper_command = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] cinder_sys_admin.user = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] service_user.auth_section = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] service_user.auth_type = password {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] service_user.cafile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] service_user.certfile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] service_user.collect_timing = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] service_user.insecure = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] service_user.keyfile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] service_user.send_service_user_token = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] service_user.split_loggers = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] service_user.timeout = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] glance.auth_section = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] glance.auth_type = password {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] glance.certfile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] glance.collect_timing = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] glance.insecure = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] glance.keyfile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] glance.region_name = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] glance.split_loggers = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] glance.timeout = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.backend_availability_zone = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.chap_password = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.chap_username = {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.disk_geometry = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.driver_client_cert = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.driver_client_cert_key = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.driver_data_namespace = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.driver_use_ssl = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.extra_capabilities = {} {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.filter_function = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.goodness_function = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.iscsi_target_flags = {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.iscsi_write_cache = on {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.iser_helper = tgtadm {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.iser_port = 3260 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.lvm_share_target = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.lvm_type = auto {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.num_shell_tries = 3 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.replication_device = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.report_discard_supported = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.reserved_percentage = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.target_helper = tgtadm {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.target_port = 3260 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.target_protocol = iscsi {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.trace_flags = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.unique_fqdn_network = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.use_chap_auth = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.volume_backend_name = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.volume_clear = zero {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.volume_clear_ionice = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.volume_clear_size = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_reports.file_event_handler = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_reports.log_dir = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.backend_host = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.chap_password = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.chap_username = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.disk_geometry = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.driver_client_cert = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.extra_capabilities = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.filter_function = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.goodness_function = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.iser_helper = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.iser_ip_address = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.iser_port = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.lvm_share_target = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.lvm_type = auto {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.num_shell_tries = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.replication_device = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.report_discard_supported = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.reserved_percentage = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.scst_target_driver = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.storage_protocol = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.target_helper = lioadm {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.target_ip_address = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.target_port = 3260 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.trace_flags = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.use_chap_auth = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.volume_clear = zero {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.volume_clear_size = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] lvmdriver-1.volumes_dir = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.ssl = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_notifications.driver = [] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_notifications.retry = -1 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] key_manager.fixed_key = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican.barbican_api_version = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican.barbican_endpoint = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican.barbican_endpoint_type = public {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican.barbican_region_name = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican.cafile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican.certfile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican.collect_timing = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican.insecure = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican.keyfile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican.number_of_retries = 60 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican.retry_delay = 1 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican.send_service_user_token = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican.split_loggers = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican.timeout = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican.verify_ssl = True {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican.verify_ssl_path = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican_service_user.auth_section = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican_service_user.auth_type = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican_service_user.cafile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican_service_user.certfile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican_service_user.collect_timing = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican_service_user.insecure = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican_service_user.keyfile = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican_service_user.split_loggers = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] barbican_service_user.timeout = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] vault.approle_role_id = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] vault.approle_secret_id = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] vault.auth_method = approle {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] vault.auth_path = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] vault.kv_mountpoint = secret {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] vault.kv_path = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] vault.kv_version = 2 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] vault.namespace = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] vault.root_token_id = **** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] vault.ssl_ca_crt_file = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] vault.timeout = 60.0 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] vault.token_file = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] vault.token_role = None {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] vault.use_ssl = False {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:30:18 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] ******************************************************************************** {{(pid=77310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 24 09:30:18 devstack sudo[77462]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:18 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.381s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:18 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:18 devstack sudo[77587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 09:30:18 devstack sudo[77587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:19 devstack sudo[77587]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:19 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.248s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:19 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:30:19 devstack cinder-volume[77458]: INFO cinder.brick.local_dev.lvm [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 24 09:30:19 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:19 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:19 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:19 devstack sudo[77689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 09:30:19 devstack sudo[77689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:19 devstack sudo[77689]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:19 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:19 devstack cinder-volume[77458]: DEBUG cinder.brick.local_dev.lvm [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77458) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 24 09:30:19 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:19 devstack sudo[77773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 09:30:19 devstack sudo[77773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:19 devstack sudo[77773]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:19 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.499s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:20 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:20 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:20 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:20 devstack sudo[77954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 09:30:20 devstack sudo[77954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:20 devstack sudo[77954]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:20 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.327s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:20 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:20 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:20 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:20 devstack sudo[78071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 24 09:30:20 devstack sudo[78071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:20 devstack sudo[78071]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:20 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.244s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:20 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:20 devstack sudo[78074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 09:30:20 devstack sudo[78074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:20 devstack sudo[78074]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:20 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:20 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:20 devstack sudo[78147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 09:30:20 devstack sudo[78147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:21 devstack sudo[78147]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:21 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:21 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:21 devstack sudo[78160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 09:30:21 devstack sudo[78160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:21 devstack sudo[78160]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:21 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:21 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:21 devstack sudo[78175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 09:30:21 devstack sudo[78175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:21 devstack sudo[78175]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:21 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.332s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:21 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:21 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:21 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:21 devstack sudo[78254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 09:30:21 devstack sudo[78254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:22 devstack sudo[78254]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:22 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:22 devstack cinder-volume[77458]: INFO cinder.volume.drivers.lvm [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 24 09:30:22 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:22 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:22 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:22 devstack sudo[78258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 09:30:22 devstack sudo[78258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:22 devstack sudo[78258]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:22 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:22 devstack cinder-volume[77458]: DEBUG cinder.volume.drivers.lvm [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Updating volume stats {{(pid=77458) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 09:30:22 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:22 devstack sudo[78267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 09:30:22 devstack sudo[78267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:22 devstack sudo[78267]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:22 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:22 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:22 devstack sudo[78270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 09:30:22 devstack sudo[78270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:22 devstack sudo[78270]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:22 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:22 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:22 devstack sudo[78273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 09:30:22 devstack sudo[78273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:23 devstack sudo[78273]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:23 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:23 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:23 devstack sudo[78276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 09:30:23 devstack sudo[78276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:23 devstack sudo[78276]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:23 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:23 devstack cinder-volume[77458]: INFO cinder.volume.driver [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Driver hasn't implemented _init_vendor_properties() Jul 24 09:30:23 devstack cinder-volume[77458]: DEBUG cinder.volume.driver [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77458) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 24 09:30:23 devstack cinder-volume[77458]: DEBUG oslo_db.sqlalchemy.engines [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77458) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 09:30:23 devstack cinder-volume[77458]: DEBUG dbcounter [-] [77458] Writer thread running {{(pid=77458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 09:30:23 devstack cinder-volume[77458]: DEBUG cinder.db.api [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Building query based on filter {{(pid=77458) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 24 09:30:23 devstack cinder-volume[77458]: DEBUG cinder.image.image_utils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77458) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 24 09:30:23 devstack cinder-volume[77458]: INFO cinder.keymgr.migration [None req-3d731df7-47b6-4e99-82da-8e6c03f9e66d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 24 09:30:23 devstack cinder-volume[77458]: DEBUG cinder.volume.drivers.lvm [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Updating volume stats {{(pid=77458) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 09:30:23 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:23 devstack sudo[78279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 09:30:23 devstack sudo[78279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:23 devstack sudo[78279]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:23 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:23 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:23 devstack sudo[78284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 09:30:23 devstack sudo[78284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:24 devstack sudo[78284]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:24 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:24 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:24 devstack sudo[78288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 09:30:24 devstack sudo[78288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:24 devstack sudo[78288]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:24 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:24 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:24 devstack sudo[78291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 09:30:24 devstack sudo[78291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:24 devstack sudo[78291]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:24 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:24 devstack cinder-volume[77458]: DEBUG cinder.manager [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Notifying Schedulers of capabilities ... {{(pid=77458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:30:24 devstack cinder-volume[77458]: INFO cinder.volume.manager [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Driver initialization completed successfully. Jul 24 09:30:24 devstack cinder-volume[77458]: INFO cinder.manager [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Initiating service 2 cleanup Jul 24 09:30:24 devstack cinder-volume[77458]: INFO cinder.manager [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Service 2 cleanup completed. Jul 24 09:30:24 devstack cinder-volume[77458]: DEBUG cinder.service [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Creating RPC server for service cinder-volume {{(pid=77458) start /opt/stack/cinder/cinder/service.py:231}} Jul 24 09:30:24 devstack cinder-volume[77458]: DEBUG cinder.service [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77458) start /opt/stack/cinder/cinder/service.py:237}} Jul 24 09:30:24 devstack cinder-volume[77458]: INFO cinder.volume.manager [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 24 09:30:24 devstack cinder-volume[77458]: DEBUG cinder.volume.drivers.lvm [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Updating volume stats {{(pid=77458) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 09:30:24 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:24 devstack sudo[78296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 09:30:24 devstack sudo[78296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:25 devstack sudo[78296]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:25 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:25 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:25 devstack sudo[78299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 09:30:25 devstack sudo[78299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:25 devstack sudo[78299]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:25 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:25 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:25 devstack sudo[78302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 09:30:25 devstack sudo[78302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:25 devstack sudo[78302]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:25 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:25 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:30:25 devstack sudo[78308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 09:30:25 devstack sudo[78308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:30:25 devstack sudo[78308]: pam_unix(sudo:session): session closed for user root Jul 24 09:30:25 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:30:25 devstack cinder-volume[77458]: INFO cinder.volume.manager [None req-db536a8d-e3f0-4609-aa2b-4a0201ee2013 None None] Driver post RPC initialization completed successfully. Jul 24 09:30:28 devstack cinder-volume[77310]: DEBUG dbcounter [-] [77310] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:30:35 devstack cinder-volume[77458]: DEBUG dbcounter [-] [77458] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:30:35 devstack cinder-volume[77458]: DEBUG dbcounter [-] [77458] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=77458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:31:16 devstack cinder-volume[77458]: DEBUG oslo_service.periodic_task [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Running periodic task VolumeManager._thread_info {{(pid=77458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:31:16 devstack cinder-volume[77458]: DEBUG cinder.volume.manager [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] thread count: 6 {{(pid=77458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:31:16 devstack cinder-volume[77458]: DEBUG cinder.volume.manager [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] thread info: [<_MainThread(MainThread, started 131438914785408)>, , , , , ] {{(pid=77458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:32:16 devstack cinder-volume[77458]: DEBUG oslo_service.periodic_task [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:32:16 devstack cinder-volume[77458]: DEBUG cinder.volume.drivers.lvm [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Updating volume stats {{(pid=77458) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 09:32:16 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:32:16 devstack sudo[83536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 09:32:16 devstack sudo[83536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:32:17 devstack sudo[83536]: pam_unix(sudo:session): session closed for user root Jul 24 09:32:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:32:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:32:17 devstack sudo[83539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 09:32:17 devstack sudo[83539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:32:17 devstack sudo[83539]: pam_unix(sudo:session): session closed for user root Jul 24 09:32:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:32:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:32:17 devstack sudo[83542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 09:32:17 devstack sudo[83542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:32:17 devstack sudo[83542]: pam_unix(sudo:session): session closed for user root Jul 24 09:32:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:32:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:32:17 devstack sudo[83545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 09:32:17 devstack sudo[83545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:32:17 devstack sudo[83545]: pam_unix(sudo:session): session closed for user root Jul 24 09:32:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:32:17 devstack cinder-volume[77458]: DEBUG cinder.manager [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Notifying Schedulers of capabilities ... {{(pid=77458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:32:17 devstack cinder-volume[77458]: DEBUG oslo_service.periodic_task [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Running periodic task VolumeManager._thread_info {{(pid=77458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:32:17 devstack cinder-volume[77458]: DEBUG cinder.volume.manager [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] thread count: 6 {{(pid=77458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:32:17 devstack cinder-volume[77458]: DEBUG cinder.volume.manager [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] thread info: [<_MainThread(MainThread, started 131438914785408)>, , , , , ] {{(pid=77458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:32:35 devstack cinder-volume[77458]: DEBUG dbcounter [-] [77458] Writing DB stats cinder:SELECT=1 {{(pid=77458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:32:35 devstack cinder-volume[77458]: DEBUG dbcounter [-] [77458] Writing DB stats cinder:UPDATE=1 {{(pid=77458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:33:16 devstack cinder-volume[77458]: DEBUG oslo_service.periodic_task [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:33:16 devstack cinder-volume[77458]: DEBUG cinder.volume.drivers.lvm [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Updating volume stats {{(pid=77458) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 09:33:16 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:33:16 devstack sudo[85389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 09:33:16 devstack sudo[85389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:33:17 devstack sudo[85389]: pam_unix(sudo:session): session closed for user root Jul 24 09:33:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:33:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:33:17 devstack sudo[85393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 09:33:17 devstack sudo[85393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:33:17 devstack sudo[85393]: pam_unix(sudo:session): session closed for user root Jul 24 09:33:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:33:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:33:17 devstack sudo[85406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 09:33:17 devstack sudo[85406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:33:17 devstack sudo[85406]: pam_unix(sudo:session): session closed for user root Jul 24 09:33:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:33:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:33:17 devstack sudo[85409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 09:33:17 devstack sudo[85409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:33:17 devstack sudo[85409]: pam_unix(sudo:session): session closed for user root Jul 24 09:33:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:33:17 devstack cinder-volume[77458]: DEBUG cinder.manager [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Notifying Schedulers of capabilities ... {{(pid=77458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:34:16 devstack cinder-volume[77458]: DEBUG oslo_service.periodic_task [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:34:16 devstack cinder-volume[77458]: DEBUG cinder.volume.drivers.lvm [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Updating volume stats {{(pid=77458) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 09:34:16 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:34:16 devstack sudo[86745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 09:34:16 devstack sudo[86745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:34:17 devstack sudo[86745]: pam_unix(sudo:session): session closed for user root Jul 24 09:34:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:34:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:34:17 devstack sudo[86748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 09:34:17 devstack sudo[86748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:34:17 devstack sudo[86748]: pam_unix(sudo:session): session closed for user root Jul 24 09:34:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:34:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:34:17 devstack sudo[86751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 09:34:17 devstack sudo[86751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:34:17 devstack sudo[86751]: pam_unix(sudo:session): session closed for user root Jul 24 09:34:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:34:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:34:17 devstack sudo[86754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 09:34:17 devstack sudo[86754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:34:17 devstack sudo[86754]: pam_unix(sudo:session): session closed for user root Jul 24 09:34:17 devstack cinder-volume[77458]: DEBUG oslo_concurrency.processutils [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.234s {{(pid=77458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:34:17 devstack cinder-volume[77458]: DEBUG cinder.manager [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Notifying Schedulers of capabilities ... {{(pid=77458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:34:17 devstack cinder-volume[77458]: DEBUG oslo_service.periodic_task [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] Running periodic task VolumeManager._thread_info {{(pid=77458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:34:17 devstack cinder-volume[77458]: DEBUG cinder.volume.manager [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] thread count: 6 {{(pid=77458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:34:17 devstack cinder-volume[77458]: DEBUG cinder.volume.manager [None req-40476c74-cda8-41e6-b4c9-1cda541365d3 None None] thread info: [<_MainThread(MainThread, started 131438914785408)>, , , , , ] {{(pid=77458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:34:35 devstack cinder-volume[77458]: DEBUG dbcounter [-] [77458] Writing DB stats cinder:SELECT=1 {{(pid=77458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:34:35 devstack cinder-volume[77458]: DEBUG dbcounter [-] [77458] Writing DB stats cinder:UPDATE=1 {{(pid=77458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:34:50 devstack cinder-volume[77310]: INFO oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Caught SIGTERM, stopping children Jul 24 09:34:50 devstack cinder-volume[77310]: DEBUG oslo_concurrency.lockutils [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Acquiring lock "singleton_lock" {{(pid=77310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 09:34:50 devstack cinder-volume[77310]: DEBUG oslo_concurrency.lockutils [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Acquired lock "singleton_lock" {{(pid=77310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 09:34:50 devstack cinder-volume[77310]: DEBUG oslo_concurrency.lockutils [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Releasing lock "singleton_lock" {{(pid=77310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 09:34:50 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Stop services. {{(pid=77310) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 24 09:34:50 devstack cinder-volume[77310]: DEBUG oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Killing children. {{(pid=77310) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 24 09:34:50 devstack cinder-volume[77310]: INFO oslo_service.backend._eventlet.service [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Waiting on 1 children to exit Jul 24 09:34:55 devstack cinder-volume[77458]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 24 09:34:56 devstack cinder-volume[87527]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 24 09:34:56 devstack cinder-volume[87527]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 24 09:34:56 devstack cinder-volume[87527]: we strongly recommend against using it for new projects. Jul 24 09:34:56 devstack cinder-volume[87527]: If you are already using Eventlet, we recommend migrating to a different Jul 24 09:34:56 devstack cinder-volume[87527]: framework. For more detail see Jul 24 09:34:56 devstack cinder-volume[87527]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 24 09:34:56 devstack cinder-volume[87527]: import eventlet # noqa Jul 24 09:34:57 devstack cinder-volume[87527]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 09:34:57 devstack cinder-volume[87527]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 09:34:57 devstack cinder-volume[87527]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 09:34:58 devstack cinder-volume[87527]: INFO dbcounter [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Registered counter for database cinder Jul 24 09:34:58 devstack cinder-volume[87527]: DEBUG oslo_db.sqlalchemy.engines [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87527) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 09:34:58 devstack cinder-volume[87527]: DEBUG dbcounter [-] [87527] Writer thread running {{(pid=87527) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 09:34:58 devstack cinder-volume[87527]: INFO cinder.rpc [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 24 09:34:59 devstack cinder-volume[87527]: INFO cinder.rpc [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_db.sqlalchemy.engines [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87527) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 09:34:59 devstack cinder-volume[87527]: INFO cinder.volume.manager [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Determined volume DB was empty at startup. Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG cinder.volume.manager [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87527) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 24 09:34:59 devstack cinder-volume[87527]: INFO cinder.volume.manager [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 24 09:34:59 devstack cinder-volume[87527]: WARNING stevedore.named [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 24 09:34:59 devstack cinder-volume[87527]: WARNING castellan.key_manager [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 09:34:59 devstack cinder-volume[87527]: WARNING cinder.keymgr.conf_key_mgr [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 09:34:59 devstack cinder-volume[87527]: INFO cinder.volume.manager [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_db.sqlalchemy.engines [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87527) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 09:34:59 devstack cinder-volume[87527]: INFO oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Starting 1 workers Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Started child 87743 {{(pid=87527) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Full set of CONF: {{(pid=87527) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] ******************************************************************************** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Configuration options gathered from: {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] ================================================================================ {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] allow_availability_zone_fallback = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] allow_compression_on_image_upload = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87743]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] allowed_direct_url_schemes = [] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] api_rate_limit = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] auth_strategy = keystone {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_availability_zone = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_host = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_name = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_stats_polling_interval = 60 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backup_api_class = cinder.backup.api.API {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backup_name_template = backup-%s {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backup_use_same_host = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backup_use_temp_snapshot = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] chap_password = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] chap_username = {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cinder_internal_tenant_project_id = b49212d4c5534b11ad9d22f78bd65e81 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cinder_internal_tenant_user_id = 08f64fbbf3364618a2d8f17a4d0c8a4e {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cluster = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] compression_format = gzip {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] compute_api_class = cinder.compute.nova.API {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] config_dir = [] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] config_source = [] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] control_exchange = openstack {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] debug = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] default_availability_zone = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] default_group_type = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] default_volume_type = QuobyteHD {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] disk_geometry = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] driver_client_cert = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] driver_client_cert_key = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] driver_data_namespace = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] driver_ssl_cert_path = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] driver_ssl_cert_verify = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] driver_use_ssl = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] enable_new_services = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] enable_unsupported_driver = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] enabled_backends = ['QuobyteHD'] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] enforce_multipath_for_image_xfer = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] filter_function = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] glance_api_insecure = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] glance_api_servers = ['http://192.168.122.135/image'] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] glance_api_ssl_compression = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] glance_ca_certificates_file = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] glance_catalog_info = image:glance:publicURL {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] glance_certfile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] glance_keyfile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] glance_num_retries = 3 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] glance_request_timeout = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] goodness_function = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] graceful_shutdown_timeout = 5 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] group_api_class = cinder.group.api.API {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] host = devstack {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] image_compress_on_upload = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] image_conversion_address_space_limit = 1 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] image_conversion_cpu_limit = 60 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] image_conversion_disable = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] image_upload_use_cinder_backend = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] image_upload_use_internal_tenant = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] image_volume_cache_enabled = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] image_volume_cache_max_count = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] image_volume_cache_max_size_gb = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] init_host_max_objects_retrieval = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] instance_format = [instance: %(uuid)s] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] iscsi_target_flags = {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] iscsi_write_cache = on {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] iser_helper = tgtadm {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] iser_ip_address = 192.168.122.135 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] iser_port = 3260 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] log_color = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] log_config_append = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] log_dir = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] log_file = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] log_options = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] log_rotate_interval = 1 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] log_rotate_interval_type = days {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] log_rotation_type = none {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] max_age = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] max_logfile_count = 30 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] max_logfile_size_mb = 200 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87743]: INFO cinder.volume.manager [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Starting volume driver QuobyteDriver (1.2) Jul 24 09:34:59 devstack cinder-volume[87743]: DEBUG cinder.volume.drivers.remotefs [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87743) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] max_over_subscription_ratio = 20.0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] message_reap_interval = 86400 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] message_ttl = 2592000 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] migration_create_volume_timeout_secs = 300 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] monkey_patch = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] monkey_patch_modules = [] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] my_ip = 192.168.122.135 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] no_snapshot_gb_quota = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] num_iser_scan_tries = 3 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] num_shell_tries = 3 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] num_volume_device_scan_tries = 3 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] nvmeof_conn_info_version = 1 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] nvmet_ns_id = 10 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] nvmet_port_id = 1 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] osapi_max_limit = 1000 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] osapi_volume_ext_list = [] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] osapi_volume_listen = 0.0.0.0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] osapi_volume_listen_port = 8776 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] osapi_volume_use_ssl = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] osapi_volume_workers = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] per_volume_size_limit = -1 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] periodic_fuzzy_delay = 60 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] periodic_interval = 60 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] project_id_regex = [0-9a-f\-]+ {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] public_endpoint = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] publish_errors = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] quota_backup_gigabytes = 1000 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] quota_backups = 10 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] quota_gigabytes = 1000 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] quota_groups = 10 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] quota_snapshots = 10 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] quota_volumes = 10 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] rate_limit_burst = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] rate_limit_except_level = CRITICAL {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] rate_limit_interval = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] reinit_driver_count = 3 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] replication_device = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] report_discard_supported = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] report_interval = 120 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] reservation_clean_interval = 86400 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] reservation_expire = 86400 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] reserved_image_namespaces = [] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] reserved_percentage = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] rpc_response_timeout = 120 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] run_external_periodic_tasks = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] scst_target_driver = iscsi {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] scst_target_iqn_name = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] service_down_time = 720 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] shell_completion = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] snapshot_name_template = snapshot-%s {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] split_loggers = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] state_path = /opt/stack/data/cinder {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] storage_availability_zone = nova {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] storage_protocol = iSCSI {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] syslog_log_facility = LOG_USER {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] target_helper = lioadm {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] target_ip_address = 192.168.122.135 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] target_port = 3260 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] target_protocol = iscsi {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] target_secondary_ip_addresses = [] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] trace_flags = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] transfer_api_class = cinder.transfer.api.API {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] transport_url = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] until_refresh = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] use_chap_auth = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] use_default_quota_class = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] use_journal = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] use_json = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] use_multipath_for_image_xfer = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] use_stderr = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] use_syslog = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] verify_glance_signatures = enabled {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] volume_api_class = cinder.volume.api.API {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] volume_backend_name = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] volume_clear = zero {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] volume_clear_ionice = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] volume_clear_size = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] volume_copy_bps_limit = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] volume_dd_blocksize = 1M {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] volume_name_template = volume-%s {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] volume_service_inithost_offload = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] volume_usage_audit_period = month {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] zoning_mode = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_concurrency.disable_process_locking = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.auth_section = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.auth_type = password {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.auth_version = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.cache = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.certfile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.delay_auth_decision = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.http_connect_timeout = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.include_service_catalog = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.insecure = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.interface = public {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.keyfile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.memcache_password = {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.memcache_username = {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.region_name = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.service_token_roles_required = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.service_type = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.token_cache_time = 300 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.backend = dogpile.cache.null {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.backend_argument = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.backend_expiration_time = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.config_prefix = cache.oslo {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.debug_cache_backend = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.enable_retry_client = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.enable_socket_keepalive = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.enabled = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.expiration_time = 600 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.hashclient_retry_attempts = 2 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.memcache_dead_retry = 300 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.memcache_pool_maxsize = 10 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.memcache_sasl_enabled = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.password = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.proxies = [] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.redis_db = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.redis_sentinel_service_name = mymaster {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.redis_server = localhost:6379 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.retry_attempts = 2 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.retry_delay = 0.0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.socket_keepalive_count = 1 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.socket_keepalive_idle = 1 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.socket_keepalive_interval = 1 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.socket_timeout = 1.0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.tls_allowed_ciphers = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.tls_cafile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.tls_certfile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.tls_enabled = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.tls_keyfile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cache.username = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] coordination.backend_url = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.asyncio_connection = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.asyncio_slave_connection = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.backend = sqlalchemy {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.connection = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.connection_debug = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.connection_parameters = {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.connection_recycle_time = 3600 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.connection_trace = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.db_inc_retry_interval = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.db_max_retries = 20 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.db_max_retry_interval = 10 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.db_retry_interval = 1 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.max_overflow = 50 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.max_pool_size = 5 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.max_retries = 10 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.mysql_wsrep_sync_wait = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.pool_timeout = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.retry_interval = 10 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.slave_connection = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.sqlite_synchronous = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.synchronous_reader = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] database.use_db_reconnect = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] profiler.connection_string = messaging:// {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] profiler.enabled = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] profiler.es_doc_type = notification {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] profiler.es_scroll_size = 10000 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] profiler.es_scroll_time = 2m {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] profiler.filter_error_trace = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] profiler.hmac_keys = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] profiler.sentinel_service_name = mymaster {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] profiler.socket_timeout = 0.1 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] profiler.trace_requests = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] profiler.trace_sqlalchemy = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] profiler_jaeger.process_tags = {} {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] profiler_jaeger.service_name_prefix = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] profiler_otlp.service_name_prefix = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_policy.enforce_new_defaults = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_policy.policy_default_rule = default {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_policy.policy_file = policy.yaml {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_policy.remote_timeout = 60.0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] privsep_osbrick.group = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] privsep_osbrick.helper_command = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] privsep_osbrick.user = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cinder_sys_admin.group = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cinder_sys_admin.helper_command = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] cinder_sys_admin.user = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] service_user.auth_section = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] service_user.auth_type = password {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] service_user.cafile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] service_user.certfile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] service_user.collect_timing = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] service_user.insecure = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] service_user.keyfile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] service_user.send_service_user_token = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] service_user.split_loggers = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] service_user.timeout = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] glance.auth_section = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] glance.auth_type = password {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] glance.certfile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87743]: DEBUG cinder.volume.drivers.quobyte [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87743) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 24 09:34:59 devstack cinder-volume[87743]: WARNING cinder.volume.drivers.quobyte [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 24 09:34:59 devstack cinder-volume[87743]: WARNING cinder.volume.drivers.quobyte [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] glance.collect_timing = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] glance.insecure = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] glance.keyfile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] glance.region_name = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] glance.split_loggers = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] glance.timeout = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.backend_availability_zone = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.chap_password = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.chap_username = {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.disk_geometry = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.driver_client_cert = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.driver_client_cert_key = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.driver_data_namespace = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.driver_use_ssl = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.enable_unsupported_driver = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.extra_capabilities = {} {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.filter_function = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.goodness_function = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87743]: DEBUG oslo_concurrency.processutils [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Running cmd (subprocess): mount.quobyte {{(pid=87743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.iscsi_target_flags = {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.iscsi_write_cache = on {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.iser_helper = tgtadm {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.iser_port = 3260 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.nas_host = {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.nas_login = admin {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.nas_mount_options = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.nas_password = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.nas_private_key = {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.nas_share_path = {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.nas_ssh_port = 22 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.num_shell_tries = 3 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.nvmet_port_id = 1 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.quobyte_client_cfg = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.quobyte_volume_url = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.replication_device = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.report_discard_supported = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.reserved_percentage = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.scst_target_driver = iscsi {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.scst_target_iqn_name = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.storage_protocol = iSCSI {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.target_helper = tgtadm {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.target_port = 3260 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.target_protocol = iscsi {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.trace_flags = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.unique_fqdn_network = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.use_chap_auth = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.volume_backend_name = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.volume_clear = zero {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.volume_clear_ionice = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.volume_clear_size = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_reports.file_event_handler = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_reports.log_dir = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.backend_availability_zone = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.backend_host = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.chap_password = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.chap_username = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.chiscsi_conf = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.disk_geometry = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.driver_client_cert = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.driver_client_cert_key = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.driver_data_namespace = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.driver_use_ssl = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.extra_capabilities = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.filter_function = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.goodness_function = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.iscsi_target_flags = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.iscsi_write_cache = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.iser_helper = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.iser_ip_address = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.iser_port = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.iser_target_prefix = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.nas_host = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.nas_login = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.nas_mount_options = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.nas_password = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.nas_private_key = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.nas_share_path = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.nas_ssh_port = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.num_shell_tries = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.nvmet_ns_id = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.nvmet_port_id = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.replication_device = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.report_discard_supported = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.reserved_percentage = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.scst_target_driver = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.storage_protocol = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.target_helper = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.target_ip_address = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.target_port = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.target_prefix = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.target_protocol = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.trace_flags = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.unique_fqdn_network = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.use_chap_auth = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.volume_clear = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.volume_clear_ionice = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.volume_clear_size = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] QuobyteHD.volumes_dir = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.ssl = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.ssl_version = {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_notifications.driver = [] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_notifications.retry = -1 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] oslo_messaging_notifications.transport_url = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] key_manager.fixed_key = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican.barbican_api_version = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican.barbican_endpoint = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican.barbican_endpoint_type = public {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican.barbican_region_name = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican.cafile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican.certfile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican.collect_timing = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican.insecure = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican.keyfile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican.number_of_retries = 60 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican.retry_delay = 1 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican.send_service_user_token = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[77458]: DEBUG oslo_concurrency.lockutils [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Acquiring lock "singleton_lock" {{(pid=77458) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 09:34:59 devstack cinder-volume[77458]: DEBUG oslo_concurrency.lockutils [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Acquired lock "singleton_lock" {{(pid=77458) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican.split_loggers = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican.timeout = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican.verify_ssl = True {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican.verify_ssl_path = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican_service_user.auth_section = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican_service_user.auth_type = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican_service_user.cafile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[77458]: DEBUG oslo_concurrency.lockutils [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Releasing lock "singleton_lock" {{(pid=77458) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican_service_user.certfile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican_service_user.collect_timing = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican_service_user.insecure = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican_service_user.keyfile = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican_service_user.split_loggers = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] barbican_service_user.timeout = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] vault.approle_role_id = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] vault.approle_secret_id = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] vault.auth_method = approle {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] vault.auth_path = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] vault.kv_mountpoint = secret {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] vault.kv_path = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] vault.kv_version = 2 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] vault.namespace = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] vault.root_token_id = **** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] vault.ssl_ca_crt_file = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] vault.timeout = 60.0 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] vault.token_file = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] vault.token_role = None {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] vault.use_ssl = False {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:34:59 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] ******************************************************************************** {{(pid=87527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 24 09:34:59 devstack cinder-volume[77458]: WARNING amqp [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 24 09:34:59 devstack quobyte-client[87744]: Reading configuration file: /etc/quobyte/client.cfg Jul 24 09:34:59 devstack quobyte-client[87744]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 24 09:34:59 devstack cinder-volume[77458]: WARNING amqp [None req-19876b35-2983-45e8-a994-6e39c81d2869 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 24 09:34:59 devstack cinder-volume[87743]: DEBUG oslo_concurrency.processutils [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] CMD "mount.quobyte" returned: 1 in 0.177s {{(pid=87743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:34:59 devstack cinder-volume[87743]: DEBUG oslo_concurrency.lockutils [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:34:59 devstack cinder-volume[87743]: DEBUG oslo_concurrency.lockutils [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:34:59 devstack cinder-volume[87743]: DEBUG cinder.volume.drivers.quobyte [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=87743) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:34:59 devstack cinder-volume[87743]: INFO cinder.volume.drivers.quobyte [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b ... Jul 24 09:34:59 devstack cinder-volume[87743]: DEBUG oslo_concurrency.processutils [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 -c /etc/quobyte/client-cinder.cfg {{(pid=87743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:34:59 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 -c /etc/quobyte/client-cinder.cfg Jul 24 09:34:59 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:35:00 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG oslo_concurrency.processutils [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.399s {{(pid=87743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:35:00 devstack cinder-volume[87743]: INFO cinder.volume.drivers.quobyte [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b succeeded Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG cinder.volume.drivers.quobyte [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=87743) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG oslo_concurrency.lockutils [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.414s {{(pid=87743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG oslo_concurrency.processutils [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=87743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:35:00 devstack sudo[87822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:35:00 devstack sudo[87822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:35:00 devstack sudo[87822]: pam_unix(sudo:session): session closed for user root Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG oslo_concurrency.processutils [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.245s {{(pid=87743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:35:00 devstack cinder-volume[87743]: INFO cinder.volume.driver [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Driver hasn't implemented _init_vendor_properties() Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG cinder.volume.driver [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87743) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG oslo_db.sqlalchemy.engines [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87743) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG dbcounter [-] [87743] Writer thread running {{(pid=87743) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG cinder.db.api [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Building query based on filter {{(pid=87743) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG cinder.image.image_utils [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87743) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 24 09:35:00 devstack cinder-volume[87743]: INFO cinder.keymgr.migration [None req-d73df88a-33b1-4ce6-b42d-ebc25d1c8a0a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG oslo_concurrency.lockutils [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG oslo_concurrency.lockutils [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG cinder.volume.drivers.quobyte [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=87743) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG cinder.volume.drivers.quobyte [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=87743) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG oslo_concurrency.lockutils [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG oslo_concurrency.processutils [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=87743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:35:00 devstack sudo[87825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:35:00 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:35:00 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG oslo_concurrency.processutils [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.231s {{(pid=87743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG cinder.manager [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Notifying Schedulers of capabilities ... {{(pid=87743) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:35:00 devstack cinder-volume[87743]: INFO cinder.volume.manager [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Driver initialization completed successfully. Jul 24 09:35:00 devstack cinder-volume[87743]: INFO cinder.manager [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Initiating service 3 cleanup Jul 24 09:35:00 devstack cinder-volume[87743]: INFO cinder.manager [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Service 3 cleanup completed. Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG cinder.service [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Creating RPC server for service cinder-volume {{(pid=87743) start /opt/stack/cinder/cinder/service.py:231}} Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG cinder.service [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87743) start /opt/stack/cinder/cinder/service.py:237}} Jul 24 09:35:00 devstack cinder-volume[87743]: INFO cinder.volume.manager [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG oslo_concurrency.lockutils [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG oslo_concurrency.lockutils [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG cinder.volume.drivers.quobyte [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=87743) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG cinder.volume.drivers.quobyte [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=87743) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG oslo_concurrency.lockutils [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:35:00 devstack cinder-volume[87743]: DEBUG oslo_concurrency.processutils [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=87743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:35:01 devstack sudo[87831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:35:01 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:35:01 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root Jul 24 09:35:01 devstack cinder-volume[87743]: DEBUG oslo_concurrency.processutils [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.253s {{(pid=87743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:35:01 devstack cinder-volume[87743]: INFO cinder.volume.manager [None req-6fbf0424-7e77-4d0b-b605-20c2e9738c31 None None] Driver post RPC initialization completed successfully. Jul 24 09:35:05 devstack cinder-volume[87527]: INFO oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Caught SIGTERM, stopping children Jul 24 09:35:05 devstack cinder-volume[87527]: DEBUG oslo_concurrency.lockutils [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Acquiring lock "singleton_lock" {{(pid=87527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 09:35:05 devstack cinder-volume[87527]: DEBUG oslo_concurrency.lockutils [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Acquired lock "singleton_lock" {{(pid=87527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 09:35:05 devstack cinder-volume[87527]: DEBUG oslo_concurrency.lockutils [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Releasing lock "singleton_lock" {{(pid=87527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 09:35:05 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Stop services. {{(pid=87527) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 24 09:35:05 devstack cinder-volume[87527]: DEBUG oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Killing children. {{(pid=87527) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 24 09:35:05 devstack cinder-volume[87527]: INFO oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Waiting on 1 children to exit Jul 24 09:35:09 devstack cinder-volume[87743]: DEBUG oslo_concurrency.lockutils [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Acquiring lock "singleton_lock" {{(pid=87743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 09:35:09 devstack cinder-volume[87743]: DEBUG oslo_concurrency.lockutils [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Acquired lock "singleton_lock" {{(pid=87743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 09:35:09 devstack cinder-volume[87743]: DEBUG oslo_concurrency.lockutils [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Releasing lock "singleton_lock" {{(pid=87743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 09:35:09 devstack cinder-volume[87743]: WARNING amqp [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 24 09:35:09 devstack cinder-volume[87743]: WARNING amqp [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 24 09:35:09 devstack cinder-volume[87527]: INFO oslo_service.backend._eventlet.service [None req-9dc62815-fd52-47ba-8b66-2ca826dd4f2f None None] Child 87743 exited with status 0 Jul 24 09:35:09 devstack cinder-volume[88146]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 24 09:35:09 devstack cinder-volume[88146]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 24 09:35:09 devstack cinder-volume[88146]: we strongly recommend against using it for new projects. Jul 24 09:35:09 devstack cinder-volume[88146]: If you are already using Eventlet, we recommend migrating to a different Jul 24 09:35:09 devstack cinder-volume[88146]: framework. For more detail see Jul 24 09:35:09 devstack cinder-volume[88146]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 24 09:35:09 devstack cinder-volume[88146]: import eventlet # noqa Jul 24 09:35:12 devstack cinder-volume[88146]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 09:35:12 devstack cinder-volume[88146]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 09:35:12 devstack cinder-volume[88146]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 09:35:13 devstack cinder-volume[88146]: INFO dbcounter [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] Registered counter for database cinder Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_db.sqlalchemy.engines [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88146) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG dbcounter [-] [88146] Writer thread running {{(pid=88146) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 09:35:13 devstack cinder-volume[88146]: INFO cinder.rpc [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 24 09:35:13 devstack cinder-volume[88146]: INFO cinder.rpc [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_db.sqlalchemy.engines [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88146) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 09:35:13 devstack cinder-volume[88146]: INFO cinder.volume.manager [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] Determined volume DB was empty at startup. Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG cinder.volume.manager [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88146) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 24 09:35:13 devstack cinder-volume[88146]: WARNING stevedore.named [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 24 09:35:13 devstack cinder-volume[88146]: WARNING castellan.key_manager [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 09:35:13 devstack cinder-volume[88146]: WARNING cinder.keymgr.conf_key_mgr [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 09:35:13 devstack cinder-volume[88146]: INFO cinder.volume.manager [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_db.sqlalchemy.engines [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88146) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 09:35:13 devstack cinder-volume[88146]: INFO oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] Starting 1 workers Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] Started child 88488 {{(pid=88146) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] Full set of CONF: {{(pid=88146) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] ******************************************************************************** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] Configuration options gathered from: {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] ================================================================================ {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 24 09:35:13 devstack cinder-volume[88488]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] allow_availability_zone_fallback = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] allow_compression_on_image_upload = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] allowed_direct_url_schemes = [] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] api_rate_limit = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] auth_strategy = keystone {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_availability_zone = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_host = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_name = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_stats_polling_interval = 60 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backup_api_class = cinder.backup.api.API {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backup_name_template = backup-%s {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backup_use_same_host = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backup_use_temp_snapshot = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] chap_password = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] chap_username = {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cinder_internal_tenant_project_id = b49212d4c5534b11ad9d22f78bd65e81 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cinder_internal_tenant_user_id = 08f64fbbf3364618a2d8f17a4d0c8a4e {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cluster = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] compression_format = gzip {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] compute_api_class = cinder.compute.nova.API {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] config_dir = [] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] config_source = [] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] control_exchange = openstack {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] debug = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] default_availability_zone = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] default_group_type = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] default_volume_type = QuobyteHD {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] disk_geometry = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] driver_client_cert = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] driver_client_cert_key = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] driver_data_namespace = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] driver_ssl_cert_path = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] driver_ssl_cert_verify = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] driver_use_ssl = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] enable_new_services = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] enable_unsupported_driver = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] enabled_backends = ['QuobyteHD'] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] enforce_multipath_for_image_xfer = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] filter_function = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] glance_api_insecure = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] glance_api_servers = ['http://192.168.122.135/image'] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] glance_api_ssl_compression = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] glance_ca_certificates_file = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] glance_catalog_info = image:glance:publicURL {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] glance_certfile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] glance_keyfile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] glance_num_retries = 3 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] glance_request_timeout = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] goodness_function = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] graceful_shutdown_timeout = 5 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] group_api_class = cinder.group.api.API {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] host = devstack {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] image_compress_on_upload = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] image_conversion_address_space_limit = 1 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] image_conversion_cpu_limit = 60 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] image_conversion_disable = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] image_upload_use_cinder_backend = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] image_upload_use_internal_tenant = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] image_volume_cache_enabled = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] image_volume_cache_max_count = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] image_volume_cache_max_size_gb = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] init_host_max_objects_retrieval = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] instance_format = [instance: %(uuid)s] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] iscsi_target_flags = {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] iscsi_write_cache = on {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] iser_helper = tgtadm {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] iser_ip_address = 192.168.122.135 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] iser_port = 3260 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] log_color = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] log_config_append = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] log_dir = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] log_file = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] log_options = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] log_rotate_interval = 1 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] log_rotate_interval_type = days {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] log_rotation_type = none {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Starting volume driver QuobyteDriver (1.2) Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88488) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] max_age = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] max_logfile_count = 30 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] max_logfile_size_mb = 200 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] max_over_subscription_ratio = 20.0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] message_reap_interval = 86400 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] message_ttl = 2592000 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] migration_create_volume_timeout_secs = 300 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] monkey_patch = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] monkey_patch_modules = [] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] my_ip = 192.168.122.135 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] no_snapshot_gb_quota = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] num_iser_scan_tries = 3 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] num_shell_tries = 3 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] num_volume_device_scan_tries = 3 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] nvmeof_conn_info_version = 1 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] nvmet_ns_id = 10 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] nvmet_port_id = 1 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] osapi_max_limit = 1000 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] osapi_volume_ext_list = [] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] osapi_volume_listen_port = 8776 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] osapi_volume_use_ssl = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] osapi_volume_workers = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] per_volume_size_limit = -1 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] periodic_fuzzy_delay = 60 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] periodic_interval = 60 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] public_endpoint = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] publish_errors = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] quota_backup_gigabytes = 1000 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] quota_backups = 10 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] quota_gigabytes = 1000 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] quota_groups = 10 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] quota_snapshots = 10 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] quota_volumes = 10 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] rate_limit_burst = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] rate_limit_except_level = CRITICAL {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] rate_limit_interval = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] reinit_driver_count = 3 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] replication_device = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] report_discard_supported = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] report_interval = 120 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] reservation_clean_interval = 86400 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] reservation_expire = 86400 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] reserved_image_namespaces = [] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] reserved_percentage = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] rpc_response_timeout = 120 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] run_external_periodic_tasks = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] scst_target_driver = iscsi {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] scst_target_iqn_name = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] service_down_time = 720 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] shell_completion = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] snapshot_name_template = snapshot-%s {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] split_loggers = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] state_path = /opt/stack/data/cinder {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] storage_availability_zone = nova {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] storage_protocol = iSCSI {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] syslog_log_facility = LOG_USER {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] target_helper = lioadm {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] target_ip_address = 192.168.122.135 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] target_port = 3260 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] target_protocol = iscsi {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] target_secondary_ip_addresses = [] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] trace_flags = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] transport_url = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] until_refresh = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] use_chap_auth = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] use_default_quota_class = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] use_journal = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] use_json = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] use_multipath_for_image_xfer = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] use_stderr = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] use_syslog = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] verify_glance_signatures = enabled {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] volume_api_class = cinder.volume.api.API {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] volume_backend_name = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] volume_clear = zero {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] volume_clear_ionice = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] volume_clear_size = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] volume_copy_bps_limit = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] volume_dd_blocksize = 1M {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] volume_name_template = volume-%s {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] volume_service_inithost_offload = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] volume_usage_audit_period = month {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] zoning_mode = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_concurrency.disable_process_locking = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.auth_section = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.auth_type = password {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.auth_version = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.cache = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.certfile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.include_service_catalog = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.insecure = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.interface = public {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.keyfile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.memcache_password = {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.memcache_username = {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.region_name = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.service_type = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.backend = dogpile.cache.null {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.backend_argument = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.backend_expiration_time = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.config_prefix = cache.oslo {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.debug_cache_backend = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.enable_retry_client = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.enable_socket_keepalive = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.enabled = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.expiration_time = 600 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.hashclient_retry_attempts = 2 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.memcache_dead_retry = 300 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.memcache_pool_maxsize = 10 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.memcache_sasl_enabled = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.password = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.proxies = [] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.redis_db = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.redis_server = localhost:6379 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.retry_attempts = 2 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.retry_delay = 0.0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.socket_keepalive_count = 1 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.socket_keepalive_idle = 1 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.socket_keepalive_interval = 1 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.socket_timeout = 1.0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.tls_allowed_ciphers = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.tls_cafile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.tls_certfile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.tls_enabled = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88488) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.tls_keyfile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cache.username = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] coordination.backend_url = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.asyncio_connection = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.asyncio_slave_connection = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.backend = sqlalchemy {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.connection = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.connection_debug = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.connection_parameters = {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.connection_recycle_time = 3600 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.quobyte [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.connection_trace = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.db_inc_retry_interval = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.db_max_retries = 20 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.quobyte [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.db_max_retry_interval = 10 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.db_retry_interval = 1 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.max_overflow = 50 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.max_pool_size = 5 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Running cmd (subprocess): mount.quobyte {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.max_retries = 10 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.mysql_wsrep_sync_wait = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.pool_timeout = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.retry_interval = 10 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.slave_connection = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.sqlite_synchronous = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.synchronous_reader = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] database.use_db_reconnect = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] profiler.connection_string = messaging:// {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] profiler.enabled = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] profiler.es_doc_type = notification {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] profiler.es_scroll_size = 10000 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] profiler.es_scroll_time = 2m {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] profiler.filter_error_trace = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] profiler.hmac_keys = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] profiler.sentinel_service_name = mymaster {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] profiler.socket_timeout = 0.1 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] profiler.trace_requests = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] profiler.trace_sqlalchemy = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] profiler_jaeger.process_tags = {} {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] profiler_jaeger.service_name_prefix = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] profiler_otlp.service_name_prefix = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_policy.enforce_new_defaults = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_policy.policy_default_rule = default {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_policy.policy_file = policy.yaml {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] privsep_osbrick.group = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] privsep_osbrick.helper_command = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] privsep_osbrick.user = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cinder_sys_admin.group = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cinder_sys_admin.helper_command = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] cinder_sys_admin.user = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] service_user.auth_section = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] service_user.auth_type = password {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] service_user.cafile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] service_user.certfile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] service_user.collect_timing = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] service_user.insecure = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] service_user.keyfile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] service_user.send_service_user_token = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] service_user.split_loggers = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] service_user.timeout = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] glance.auth_section = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] glance.auth_type = password {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] glance.certfile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] glance.collect_timing = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] glance.insecure = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] glance.keyfile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] glance.region_name = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] glance.split_loggers = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] glance.timeout = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.backend_availability_zone = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.chap_password = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.chap_username = {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.disk_geometry = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.driver_client_cert = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.driver_client_cert_key = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.driver_data_namespace = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.driver_use_ssl = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.extra_capabilities = {} {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.filter_function = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.goodness_function = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.iscsi_target_flags = {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.iscsi_write_cache = on {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.iser_helper = tgtadm {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.iser_port = 3260 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.nas_host = {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.nas_login = admin {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.nas_mount_options = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.nas_password = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.nas_private_key = {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.nas_share_path = {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.num_shell_tries = 3 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.quobyte_volume_url = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.replication_device = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.report_discard_supported = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.reserved_percentage = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.target_helper = tgtadm {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.target_port = 3260 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.target_protocol = iscsi {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.trace_flags = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.unique_fqdn_network = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.use_chap_auth = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.volume_backend_name = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.volume_clear = zero {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.volume_clear_ionice = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.volume_clear_size = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_reports.file_event_handler = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_reports.log_dir = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.backend_availability_zone = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.backend_host = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.chap_password = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.chap_username = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.chiscsi_conf = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.disk_geometry = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.driver_client_cert = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.driver_data_namespace = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.driver_use_ssl = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.extra_capabilities = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.filter_function = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.goodness_function = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.iser_helper = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.iser_ip_address = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.iser_port = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.iser_target_prefix = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.nas_host = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.nas_login = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.nas_mount_options = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.nas_password = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.nas_private_key = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.nas_share_path = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.nas_ssh_port = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.num_shell_tries = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.nvmet_port_id = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.replication_device = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.report_discard_supported = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.reserved_percentage = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.scst_target_driver = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.storage_protocol = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.target_helper = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.target_ip_address = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.target_port = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack quobyte-client[88489]: Reading configuration file: /etc/quobyte/client.cfg Jul 24 09:35:13 devstack quobyte-client[88489]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 24 09:35:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] CMD "mount.quobyte" returned: 1 in 0.081s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.target_prefix = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.target_protocol = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:35:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:35:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.trace_flags = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.use_chap_auth = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.volume_clear = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.volume_clear_size = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] QuobyteHD.volumes_dir = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:35:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:35:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.ssl = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_notifications.driver = [] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_notifications.retry = -1 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] key_manager.fixed_key = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican.barbican_api_version = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican.barbican_endpoint = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican.barbican_endpoint_type = public {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican.barbican_region_name = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican.cafile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican.certfile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican.collect_timing = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican.insecure = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack sudo[88498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:35:13 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican.keyfile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican.number_of_retries = 60 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican.retry_delay = 1 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican.send_service_user_token = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican.split_loggers = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican.timeout = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican.verify_ssl = True {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican.verify_ssl_path = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican_service_user.auth_section = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican_service_user.auth_type = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican_service_user.cafile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican_service_user.certfile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican_service_user.collect_timing = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican_service_user.insecure = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican_service_user.keyfile = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:13 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican_service_user.split_loggers = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:14 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] barbican_service_user.timeout = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:14 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] vault.approle_role_id = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:14 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] vault.approle_secret_id = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:14 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] vault.auth_method = approle {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:14 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] vault.auth_path = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:14 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] vault.kv_mountpoint = secret {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:14 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] vault.kv_path = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:14 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] vault.kv_version = 2 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:14 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] vault.namespace = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:14 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] vault.root_token_id = **** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:14 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] vault.ssl_ca_crt_file = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:14 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] vault.timeout = 60.0 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:14 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] vault.token_file = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:14 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] vault.token_role = None {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:14 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] vault.use_ssl = False {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:14 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 09:35:14 devstack cinder-volume[88146]: DEBUG oslo_service.backend._eventlet.service [None req-9a9e29ce-495f-47eb-9a4a-d33afe474be9 None None] ******************************************************************************** {{(pid=88146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 24 09:35:14 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.244s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:35:14 devstack cinder-volume[88488]: INFO cinder.volume.driver [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Driver hasn't implemented _init_vendor_properties() Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG cinder.volume.driver [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88488) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG oslo_db.sqlalchemy.engines [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88488) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writer thread running {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG cinder.db.api [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Building query based on filter {{(pid=88488) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88488) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:35:14 devstack cinder-volume[88488]: INFO cinder.keymgr.migration [None req-db21d85b-93f4-4452-969c-6c0e828f1390 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 24 09:35:14 devstack sudo[88509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:35:14 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:35:14 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.240s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:35:14 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Driver initialization completed successfully. Jul 24 09:35:14 devstack cinder-volume[88488]: INFO cinder.manager [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Initiating service 3 cleanup Jul 24 09:35:14 devstack cinder-volume[88488]: INFO cinder.manager [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Service 3 cleanup completed. Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG cinder.service [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Creating RPC server for service cinder-volume {{(pid=88488) start /opt/stack/cinder/cinder/service.py:231}} Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG cinder.service [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88488) start /opt/stack/cinder/cinder/service.py:237}} Jul 24 09:35:14 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:35:14 devstack sudo[88512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:35:14 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:35:14 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.247s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:35:14 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-2418ecff-5ecd-421a-87d7-7ee764d58ec8 None None] Driver post RPC initialization completed successfully. Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 6 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:35:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:35:23 devstack cinder-volume[88146]: DEBUG dbcounter [-] [88146] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88146) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:35:24 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=1 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:35:24 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Flow 'volume_create_manager' (7e879001-a32d-4f5c-9140-9cbaa7ebed33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e740124a-7295-45e1-bf69-fa94f9d1a6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e740124a-7295-45e1-bf69-fa94f9d1a6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1469482339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=187b200e-0252-4b84-96d9-a5364f292918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a61903d397c4a2f8c06605b8de212e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:36:12Z,use_quota=True,user_id='5de32a3926244075bccf4fb4e177c6df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9ef1bb-a85e-468b-b878-9e7cb53d93db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9ef1bb-a85e-468b-b878-9e7cb53d93db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31aa40ac-9e35-46e2-975d-34329b5c56bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31aa40ac-9e35-46e2-975d-34329b5c56bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '187b200e-0252-4b84-96d9-a5364f292918', 'volume_name': 'volume-187b200e-0252-4b84-96d9-a5364f292918', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80af7e7a-cd98-4adf-8d0b-a88b35c9fb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80af7e7a-cd98-4adf-8d0b-a88b35c9fb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00a66df-1fbd-45a7-a68a-2e0b538bcf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:36:12 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Volume 187b200e-0252-4b84-96d9-a5364f292918: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-187b200e-0252-4b84-96d9-a5364f292918', 'volume_size': 1} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1469482339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=187b200e-0252-4b84-96d9-a5364f292918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a61903d397c4a2f8c06605b8de212e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:36:12Z,use_quota=True,user_id='5de32a3926244075bccf4fb4e177c6df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Creating volume 187b200e-0252-4b84-96d9-a5364f292918 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:36:12 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:36:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-187b200e-0252-4b84-96d9-a5364f292918 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:36:12 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-187b200e-0252-4b84-96d9-a5364f292918 1073741824 Jul 24 09:36:12 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:36:13 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Jul 24 09:36:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-187b200e-0252-4b84-96d9-a5364f292918 1073741824" returned: 0 in 0.649s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:36:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-187b200e-0252-4b84-96d9-a5364f292918 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:36:13 devstack sudo[89028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-187b200e-0252-4b84-96d9-a5364f292918 Jul 24 09:36:13 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:36:13 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root Jul 24 09:36:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-187b200e-0252-4b84-96d9-a5364f292918" returned: 0 in 0.279s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:36:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:36:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:36:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00a66df-1fbd-45a7-a68a-2e0b538bcf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-187b200e-0252-4b84-96d9-a5364f292918', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:36:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d9546c-e008-47b0-ae4c-e5bc4c27216c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:36:13 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Volume volume-187b200e-0252-4b84-96d9-a5364f292918 (187b200e-0252-4b84-96d9-a5364f292918): created successfully Jul 24 09:36:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d9546c-e008-47b0-ae4c-e5bc4c27216c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:36:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Flow 'volume_create_manager' (7e879001-a32d-4f5c-9140-9cbaa7ebed33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:36:13 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-a6ace3ba-df4c-4f04-824e-d8a2a61322be tempest-TaggedAttachmentsTest-999220636 None] Created volume successfully. Jul 24 09:36:14 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:36:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:36:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:36:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:36:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:36:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:36:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:36:15 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:36:15 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:36:15 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Jul 24 09:36:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.274s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:36:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:36:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:36:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 6 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:36:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:36:23 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:36:23 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Flow 'volume_create_manager' (0b81d1f3-8d84-4663-be3e-cb0943d98c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df99b32-5146-4ecd-9ea6-89b45f6dabb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df99b32-5146-4ecd-9ea6-89b45f6dabb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1004625492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc1a4910-c444-4481-ad78-d59046568a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac858819ad784707acccb3fe3666816d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:36:28Z,use_quota=True,user_id='d291da03c3df49da9a363b5f14f975f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0fe704d-158d-40f5-acab-a6f68503a1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0fe704d-158d-40f5-acab-a6f68503a1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95fe3912-805c-426b-a927-a8d787aefcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95fe3912-805c-426b-a927-a8d787aefcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc1a4910-c444-4481-ad78-d59046568a31', 'volume_name': 'volume-fc1a4910-c444-4481-ad78-d59046568a31', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831882dd-6ec4-4f7e-a106-25adb55098f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831882dd-6ec4-4f7e-a106-25adb55098f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c3d4bb1-bcda-4c2f-82e8-05338c0d4458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:36:28 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Volume fc1a4910-c444-4481-ad78-d59046568a31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc1a4910-c444-4481-ad78-d59046568a31', 'volume_size': 1} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1004625492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc1a4910-c444-4481-ad78-d59046568a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac858819ad784707acccb3fe3666816d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:36:28Z,use_quota=True,user_id='d291da03c3df49da9a363b5f14f975f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Creating volume fc1a4910-c444-4481-ad78-d59046568a31 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:36:28 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:36:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fc1a4910-c444-4481-ad78-d59046568a31 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:36:28 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fc1a4910-c444-4481-ad78-d59046568a31 1073741824 Jul 24 09:36:28 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:36:29 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Jul 24 09:36:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fc1a4910-c444-4481-ad78-d59046568a31 1073741824" returned: 0 in 0.725s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:36:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fc1a4910-c444-4481-ad78-d59046568a31 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:36:29 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fc1a4910-c444-4481-ad78-d59046568a31 Jul 24 09:36:29 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:36:29 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Jul 24 09:36:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fc1a4910-c444-4481-ad78-d59046568a31" returned: 0 in 0.503s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:36:29 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:36:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:36:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c3d4bb1-bcda-4c2f-82e8-05338c0d4458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc1a4910-c444-4481-ad78-d59046568a31', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:36:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (214a7227-7003-49ae-b763-562d9137c62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:36:29 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Volume volume-fc1a4910-c444-4481-ad78-d59046568a31 (fc1a4910-c444-4481-ad78-d59046568a31): created successfully Jul 24 09:36:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (214a7227-7003-49ae-b763-562d9137c62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:36:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Flow 'volume_create_manager' (0b81d1f3-8d84-4663-be3e-cb0943d98c7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:36:29 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e707c247-41a7-49f4-b192-e61759632b8b tempest-DeleteServersTestJSON-53853571 None] Created volume successfully. Jul 24 09:36:36 devstack cinder-volume[88488]: WARNING py.warnings [req-6db57a97-0ff2-4377-b225-fe071d12932a req-ee11067a-981b-4d10-903a-fd81de49e963 tempest-DeleteServersTestJSON-53853571 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 24 09:36:36 devstack cinder-volume[88488]: .first() Jul 24 09:36:36 devstack cinder-volume[88488]: Jul 24 09:36:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-6db57a97-0ff2-4377-b225-fe071d12932a req-ee11067a-981b-4d10-903a-fd81de49e963 tempest-DeleteServersTestJSON-53853571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:36:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-6db57a97-0ff2-4377-b225-fe071d12932a req-ee11067a-981b-4d10-903a-fd81de49e963 tempest-DeleteServersTestJSON-53853571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:36:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-6db57a97-0ff2-4377-b225-fe071d12932a req-ee11067a-981b-4d10-903a-fd81de49e963 tempest-DeleteServersTestJSON-53853571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:36:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-6db57a97-0ff2-4377-b225-fe071d12932a req-ee11067a-981b-4d10-903a-fd81de49e963 tempest-DeleteServersTestJSON-53853571 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-fc1a4910-c444-4481-ad78-d59046568a31', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc6ce814-ec18-453d-8553-687ef92c0d86', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:36:36 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-6db57a97-0ff2-4377-b225-fe071d12932a req-ee11067a-981b-4d10-903a-fd81de49e963 tempest-DeleteServersTestJSON-53853571 None] attachment_update completed successfully. Jul 24 09:36:43 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-36eee2b4-a319-44e1-868d-4ba18d15da28 req-184741c3-e394-4ac7-90da-bc09de4ec091 tempest-DeleteServersTestJSON-53853571 None] Terminate volume connection completed successfully. Jul 24 09:36:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-36eee2b4-a319-44e1-868d-4ba18d15da28 req-184741c3-e394-4ac7-90da-bc09de4ec091 tempest-DeleteServersTestJSON-53853571 None] Deleting attachment fc6ce814-ec18-453d-8553-687ef92c0d86. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:36:46 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:36:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Acquiring lock "cinder-fc1a4910-c444-4481-ad78-d59046568a31-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:36:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Lock "cinder-fc1a4910-c444-4481-ad78-d59046568a31-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:36:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Acquiring lock "cinder-quobyte-fc1a4910-c444-4481-ad78-d59046568a31" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:36:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Lock "cinder-quobyte-fc1a4910-c444-4481-ad78-d59046568a31" acquired by "delete_volume" :: waited 0.029s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:36:47 devstack cinder-volume[88488]: INFO oslo.privsep.daemon [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpgtfz4yxt/privsep.sock'] Jul 24 09:36:47 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpgtfz4yxt/privsep.sock Jul 24 09:36:47 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Flow 'volume_create_manager' (77daab91-1b34-4205-bcd9-9f7b8b9edb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f268f624-9481-417c-a44c-df66bede0f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f268f624-9481-417c-a44c-df66bede0f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-602746207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa59c7b8cfeb4333954af688044183ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:36:49Z,use_quota=True,user_id='1a5cc63ad4254ed6b45169cdc988ffa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba15e8f-2f00-4248-8f27-6ac7cbffce94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba15e8f-2f00-4248-8f27-6ac7cbffce94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921c72b2-8e88-42ea-8f7f-cc56ba115fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921c72b2-8e88-42ea-8f7f-cc56ba115fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba', 'volume_name': 'volume-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585619c3-216c-4b1a-bd1a-6ec445a823a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585619c3-216c-4b1a-bd1a-6ec445a823a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32491c9f-c9b9-4de4-8179-4b033fb3432a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:36:48 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Volume 8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba', 'volume_size': 1} Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-602746207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa59c7b8cfeb4333954af688044183ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:36:49Z,use_quota=True,user_id='1a5cc63ad4254ed6b45169cdc988ffa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Creating volume 8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:36:48 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:36:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:36:48 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba 1073741824 Jul 24 09:36:48 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:36:49 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Jul 24 09:36:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba 1073741824" returned: 0 in 1.026s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:36:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:36:49 devstack cinder-volume[88488]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 24 09:36:49 devstack cinder-volume[88488]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 24 09:36:49 devstack cinder-volume[88488]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 24 09:36:49 devstack cinder-volume[88488]: WARNING oslo.privsep.daemon [-] privsep log: Jul 24 09:36:49 devstack cinder-volume[88488]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 24 09:36:49 devstack cinder-volume[88488]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 24 09:36:49 devstack cinder-volume[88488]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 24 09:36:49 devstack cinder-volume[88488]: WARNING oslo.privsep.daemon [-] privsep log: Jul 24 09:36:49 devstack cinder-volume[88488]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 24 09:36:49 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba Jul 24 09:36:49 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:36:50 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Jul 24 09:36:50 devstack cinder-volume[88488]: INFO oslo.privsep.daemon [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Spawned new privsep daemon via rootwrap Jul 24 09:36:50 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Accepted privsep connection to /tmp/tmpgtfz4yxt/privsep.sock {{(pid=88488) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 24 09:36:50 devstack cinder-volume[88488]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 24 09:36:50 devstack cinder-volume[88488]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 24 09:36:50 devstack cinder-volume[88488]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 24 09:36:50 devstack cinder-volume[88488]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89999 Jul 24 09:36:50 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcd36f2-5c9b-4c74-99e5-dd2cff4d8dab]: (2,) {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:36:50 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Jul 24 09:36:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba" returned: 0 in 0.552s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:36:50 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:36:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:36:50 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[af47e3a1-1ece-43dd-b0c6-2a014f9d4098]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:36:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fc1a4910-c444-4481-ad78-d59046568a31 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:36:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32491c9f-c9b9-4de4-8179-4b033fb3432a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:36:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16674346-3d5d-4fc9-b02f-21d8d0211975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:36:50 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Volume volume-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba (8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba): created successfully Jul 24 09:36:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16674346-3d5d-4fc9-b02f-21d8d0211975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:36:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Flow 'volume_create_manager' (77daab91-1b34-4205-bcd9-9f7b8b9edb8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:36:50 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b2582090-f3e0-457f-84ba-3287b64550b5 tempest-VolumesAdminNegativeTest-2030671210 None] Created volume successfully. Jul 24 09:36:50 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fc1a4910-c444-4481-ad78-d59046568a31 Jul 24 09:36:50 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:36:51 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Jul 24 09:36:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fc1a4910-c444-4481-ad78-d59046568a31" returned: 0 in 0.795s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:36:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fc1a4910-c444-4481-ad78-d59046568a31 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:36:51 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fc1a4910-c444-4481-ad78-d59046568a31 Jul 24 09:36:51 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:36:51 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Jul 24 09:36:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fc1a4910-c444-4481-ad78-d59046568a31" returned: 0 in 0.547s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:36:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Lock "cinder-quobyte-fc1a4910-c444-4481-ad78-d59046568a31" released by "delete_volume" :: held 4.297s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:36:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7ae491fe-55c8-4cd2-ad7c-6a6f8c797f70 tempest-VolumesAdminNegativeTest-2030671210 None] Acquiring lock "cinder-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:36:51 devstack cinder-volume[88488]: WARNING cinder.quota [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:36:51 devstack cinder-volume[88488]: WARNING cinder.quota [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:36:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7ae491fe-55c8-4cd2-ad7c-6a6f8c797f70 tempest-VolumesAdminNegativeTest-2030671210 None] Lock "cinder-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:36:52 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Created reservations ['48592b0f-2aab-449c-9cf3-2a4cd47bb505', 'f94bbd97-2edc-494e-b0ae-1e82ae9d51dd', '951ee506-b05f-4161-b988-f17eeeff0d53', 'ea259e43-54ca-4091-a0b3-af0c987ad4d6'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:36:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7ae491fe-55c8-4cd2-ad7c-6a6f8c797f70 tempest-VolumesAdminNegativeTest-2030671210 None] Acquiring lock "cinder-quobyte-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:36:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7ae491fe-55c8-4cd2-ad7c-6a6f8c797f70 tempest-VolumesAdminNegativeTest-2030671210 None] Lock "cinder-quobyte-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba" acquired by "delete_volume" :: waited 0.031s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:36:52 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0a7e56-6700-4cbb-a252-8e6a42fcdf96]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:36:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ae491fe-55c8-4cd2-ad7c-6a6f8c797f70 tempest-VolumesAdminNegativeTest-2030671210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:36:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:36:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:36:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:36:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:36:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:36:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:36:52 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:36:52 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:36:52 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba Jul 24 09:36:52 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:36:52 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Jul 24 09:36:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.324s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:36:52 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:36:52 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Deleted volume successfully. Jul 24 09:36:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-721a1e94-a8ef-4217-a3e2-af727893f492 tempest-DeleteServersTestJSON-53853571 None] Lock "cinder-fc1a4910-c444-4481-ad78-d59046568a31-delete_volume" released by "delete_volume" :: held 5.357s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:36:52 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Jul 24 09:36:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ae491fe-55c8-4cd2-ad7c-6a6f8c797f70 tempest-VolumesAdminNegativeTest-2030671210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba" returned: 0 in 0.687s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:36:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ae491fe-55c8-4cd2-ad7c-6a6f8c797f70 tempest-VolumesAdminNegativeTest-2030671210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:36:53 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba Jul 24 09:36:53 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:36:53 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Jul 24 09:36:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ae491fe-55c8-4cd2-ad7c-6a6f8c797f70 tempest-VolumesAdminNegativeTest-2030671210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba" returned: 0 in 0.527s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:36:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7ae491fe-55c8-4cd2-ad7c-6a6f8c797f70 tempest-VolumesAdminNegativeTest-2030671210 None] Lock "cinder-quobyte-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba" released by "delete_volume" :: held 1.282s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:36:53 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-7ae491fe-55c8-4cd2-ad7c-6a6f8c797f70 tempest-VolumesAdminNegativeTest-2030671210 None] Created reservations ['f4664370-70b8-4ee0-bac0-190da06f88a2', '16401d5c-61fa-42e8-a37e-5bc58e2959e9', '25215229-2a78-4034-a53b-5cdbfc1e9155', '5d638bab-5476-4fa2-b7b3-1b1757c20edd'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:36:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7ae491fe-55c8-4cd2-ad7c-6a6f8c797f70 tempest-VolumesAdminNegativeTest-2030671210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:36:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7ae491fe-55c8-4cd2-ad7c-6a6f8c797f70 tempest-VolumesAdminNegativeTest-2030671210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:36:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7ae491fe-55c8-4cd2-ad7c-6a6f8c797f70 tempest-VolumesAdminNegativeTest-2030671210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:36:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7ae491fe-55c8-4cd2-ad7c-6a6f8c797f70 tempest-VolumesAdminNegativeTest-2030671210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:36:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7ae491fe-55c8-4cd2-ad7c-6a6f8c797f70 tempest-VolumesAdminNegativeTest-2030671210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:36:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ae491fe-55c8-4cd2-ad7c-6a6f8c797f70 tempest-VolumesAdminNegativeTest-2030671210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:36:53 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:36:53 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:36:54 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Jul 24 09:36:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ae491fe-55c8-4cd2-ad7c-6a6f8c797f70 tempest-VolumesAdminNegativeTest-2030671210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.546s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:36:54 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-7ae491fe-55c8-4cd2-ad7c-6a6f8c797f70 tempest-VolumesAdminNegativeTest-2030671210 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:36:54 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-7ae491fe-55c8-4cd2-ad7c-6a6f8c797f70 tempest-VolumesAdminNegativeTest-2030671210 None] Deleted volume successfully. Jul 24 09:36:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7ae491fe-55c8-4cd2-ad7c-6a6f8c797f70 tempest-VolumesAdminNegativeTest-2030671210 None] Lock "cinder-8ee2feeb-a1d2-4b36-835f-8e5a1d16d8ba-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:37:03 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=17,cinder:SELECT=11,cinder:INSERT=3,cinder:DELETE=2 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:37:04 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=26,cinder:SELECT=21,cinder:INSERT=7,cinder:DELETE=2 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:37:14 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:37:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:37:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:37:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:37:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:37:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:37:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:37:15 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:37:15 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:37:15 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Jul 24 09:37:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.633s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:37:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:37:25 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=1 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:37:25 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=1 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:37:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-e95142b9-4ec5-4d5c-81ff-4c90a14c5220 req-0e509306-ca0f-4664-bd77-2ecdfe3ed649 tempest-TaggedAttachmentsTest-999220636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:37:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-e95142b9-4ec5-4d5c-81ff-4c90a14c5220 req-0e509306-ca0f-4664-bd77-2ecdfe3ed649 tempest-TaggedAttachmentsTest-999220636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:37:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-e95142b9-4ec5-4d5c-81ff-4c90a14c5220 req-0e509306-ca0f-4664-bd77-2ecdfe3ed649 tempest-TaggedAttachmentsTest-999220636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.059s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:37:31 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-e95142b9-4ec5-4d5c-81ff-4c90a14c5220 req-0e509306-ca0f-4664-bd77-2ecdfe3ed649 tempest-TaggedAttachmentsTest-999220636 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-187b200e-0252-4b84-96d9-a5364f292918', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f716ae39-ce63-423d-b8f9-b160db57ffe8', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:37:31 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-e95142b9-4ec5-4d5c-81ff-4c90a14c5220 req-0e509306-ca0f-4664-bd77-2ecdfe3ed649 tempest-TaggedAttachmentsTest-999220636 None] attachment_update completed successfully. Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Flow 'volume_create_manager' (f96bb088-7400-420c-a7bf-af7c073042fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f670b1-44c1-4a00-a5b0-a6242d009adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f670b1-44c1-4a00-a5b0-a6242d009adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1335947373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0caff34a-f397-445e-bc07-fbaef91fdbf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e082b92a9de74788b74c01da3cd909f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:37:35Z,use_quota=True,user_id='06af70e2f71e423f91a9ca5383ddfbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05425176-42f5-4c1d-9fb2-0e0d8629fbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05425176-42f5-4c1d-9fb2-0e0d8629fbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40500b6-4e19-4c72-9eb8-c26bf026d556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40500b6-4e19-4c72-9eb8-c26bf026d556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0caff34a-f397-445e-bc07-fbaef91fdbf1', 'volume_name': 'volume-0caff34a-f397-445e-bc07-fbaef91fdbf1', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5bcd1a-d4ab-4e57-9c4e-58b07217339c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5bcd1a-d4ab-4e57-9c4e-58b07217339c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2f1536-a578-4370-8a2a-bf312f484ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:37:35 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Volume 0caff34a-f397-445e-bc07-fbaef91fdbf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0caff34a-f397-445e-bc07-fbaef91fdbf1', 'volume_size': 1} Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1335947373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0caff34a-f397-445e-bc07-fbaef91fdbf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e082b92a9de74788b74c01da3cd909f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:37:35Z,use_quota=True,user_id='06af70e2f71e423f91a9ca5383ddfbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Creating volume 0caff34a-f397-445e-bc07-fbaef91fdbf1 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:37:35 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:37:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0caff34a-f397-445e-bc07-fbaef91fdbf1 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:37:35 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0caff34a-f397-445e-bc07-fbaef91fdbf1 1073741824 Jul 24 09:37:35 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:37:36 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Jul 24 09:37:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0caff34a-f397-445e-bc07-fbaef91fdbf1 1073741824" returned: 0 in 0.989s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:37:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0caff34a-f397-445e-bc07-fbaef91fdbf1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:37:36 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0caff34a-f397-445e-bc07-fbaef91fdbf1 Jul 24 09:37:36 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:37:37 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Jul 24 09:37:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0caff34a-f397-445e-bc07-fbaef91fdbf1" returned: 0 in 0.420s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:37:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:37:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:37:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2f1536-a578-4370-8a2a-bf312f484ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0caff34a-f397-445e-bc07-fbaef91fdbf1', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:37:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0695672-d49d-4728-a88e-f177f328811b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:37:37 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-bd9633df-a932-4eba-85df-434fca15be97 req-06f69c69-c42b-4a20-875a-796bd92b4f3e tempest-TaggedAttachmentsTest-999220636 None] Terminate volume connection completed successfully. Jul 24 09:37:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-bd9633df-a932-4eba-85df-434fca15be97 req-06f69c69-c42b-4a20-875a-796bd92b4f3e tempest-TaggedAttachmentsTest-999220636 None] Deleting attachment f716ae39-ce63-423d-b8f9-b160db57ffe8. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:37:37 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Volume volume-0caff34a-f397-445e-bc07-fbaef91fdbf1 (0caff34a-f397-445e-bc07-fbaef91fdbf1): created successfully Jul 24 09:37:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0695672-d49d-4728-a88e-f177f328811b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:37:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Flow 'volume_create_manager' (f96bb088-7400-420c-a7bf-af7c073042fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:37:37 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-08976881-6b59-49df-9c97-6aebcb11850d tempest-ServerRescueNegativeTestJSON-1109232221 None] Created volume successfully. Jul 24 09:37:47 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=10,cinder:UPDATE=6 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:37:47 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:38:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3e4c3f30-8a19-4976-b1a4-b810ddd79c90 tempest-ServerRescueNegativeTestJSON-1109232221 None] Acquiring lock "cinder-0caff34a-f397-445e-bc07-fbaef91fdbf1-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:38:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3e4c3f30-8a19-4976-b1a4-b810ddd79c90 tempest-ServerRescueNegativeTestJSON-1109232221 None] Lock "cinder-0caff34a-f397-445e-bc07-fbaef91fdbf1-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:38:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3e4c3f30-8a19-4976-b1a4-b810ddd79c90 tempest-ServerRescueNegativeTestJSON-1109232221 None] Acquiring lock "cinder-quobyte-0caff34a-f397-445e-bc07-fbaef91fdbf1" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:38:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3e4c3f30-8a19-4976-b1a4-b810ddd79c90 tempest-ServerRescueNegativeTestJSON-1109232221 None] Lock "cinder-quobyte-0caff34a-f397-445e-bc07-fbaef91fdbf1" acquired by "delete_volume" :: waited 0.023s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:38:01 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4c4545-35cb-4f89-bed3-adf5e36a1993]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:38:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3e4c3f30-8a19-4976-b1a4-b810ddd79c90 tempest-ServerRescueNegativeTestJSON-1109232221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0caff34a-f397-445e-bc07-fbaef91fdbf1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:01 devstack sudo[91343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0caff34a-f397-445e-bc07-fbaef91fdbf1 Jul 24 09:38:01 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:02 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3e4c3f30-8a19-4976-b1a4-b810ddd79c90 tempest-ServerRescueNegativeTestJSON-1109232221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0caff34a-f397-445e-bc07-fbaef91fdbf1" returned: 0 in 0.567s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3e4c3f30-8a19-4976-b1a4-b810ddd79c90 tempest-ServerRescueNegativeTestJSON-1109232221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0caff34a-f397-445e-bc07-fbaef91fdbf1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:02 devstack sudo[91354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0caff34a-f397-445e-bc07-fbaef91fdbf1 Jul 24 09:38:02 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:02 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-413dd6c8-dfe3-4810-83fc-b543ac736b63 tempest-TaggedAttachmentsTest-999220636 None] Acquiring lock "cinder-187b200e-0252-4b84-96d9-a5364f292918-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:38:02 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3e4c3f30-8a19-4976-b1a4-b810ddd79c90 tempest-ServerRescueNegativeTestJSON-1109232221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0caff34a-f397-445e-bc07-fbaef91fdbf1" returned: 0 in 0.711s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3e4c3f30-8a19-4976-b1a4-b810ddd79c90 tempest-ServerRescueNegativeTestJSON-1109232221 None] Lock "cinder-quobyte-0caff34a-f397-445e-bc07-fbaef91fdbf1" released by "delete_volume" :: held 1.381s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:38:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-413dd6c8-dfe3-4810-83fc-b543ac736b63 tempest-TaggedAttachmentsTest-999220636 None] Lock "cinder-187b200e-0252-4b84-96d9-a5364f292918-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:38:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-413dd6c8-dfe3-4810-83fc-b543ac736b63 tempest-TaggedAttachmentsTest-999220636 None] Acquiring lock "cinder-quobyte-187b200e-0252-4b84-96d9-a5364f292918" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:38:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-413dd6c8-dfe3-4810-83fc-b543ac736b63 tempest-TaggedAttachmentsTest-999220636 None] Lock "cinder-quobyte-187b200e-0252-4b84-96d9-a5364f292918" acquired by "delete_volume" :: waited 0.061s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:38:03 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-3e4c3f30-8a19-4976-b1a4-b810ddd79c90 tempest-ServerRescueNegativeTestJSON-1109232221 None] Created reservations ['2befc40d-1477-4c28-a0d8-ce2567751db7', '51c05fb8-96f0-4540-a64d-07bc0bf68a25', '5a8721fc-f18f-48ca-8be7-4fb32c23d878', '5b56f80b-6a33-4f12-b66a-fbf715207cdb'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:38:03 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4f69bb-9124-413e-9fd3-bf6ec17cb342]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:38:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-413dd6c8-dfe3-4810-83fc-b543ac736b63 tempest-TaggedAttachmentsTest-999220636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-187b200e-0252-4b84-96d9-a5364f292918 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:03 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-187b200e-0252-4b84-96d9-a5364f292918 Jul 24 09:38:03 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3e4c3f30-8a19-4976-b1a4-b810ddd79c90 tempest-ServerRescueNegativeTestJSON-1109232221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:38:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3e4c3f30-8a19-4976-b1a4-b810ddd79c90 tempest-ServerRescueNegativeTestJSON-1109232221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:38:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3e4c3f30-8a19-4976-b1a4-b810ddd79c90 tempest-ServerRescueNegativeTestJSON-1109232221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:38:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3e4c3f30-8a19-4976-b1a4-b810ddd79c90 tempest-ServerRescueNegativeTestJSON-1109232221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:38:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3e4c3f30-8a19-4976-b1a4-b810ddd79c90 tempest-ServerRescueNegativeTestJSON-1109232221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:38:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3e4c3f30-8a19-4976-b1a4-b810ddd79c90 tempest-ServerRescueNegativeTestJSON-1109232221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:03 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:38:03 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:04 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3e4c3f30-8a19-4976-b1a4-b810ddd79c90 tempest-ServerRescueNegativeTestJSON-1109232221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.630s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:04 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-3e4c3f30-8a19-4976-b1a4-b810ddd79c90 tempest-ServerRescueNegativeTestJSON-1109232221 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:38:04 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-3e4c3f30-8a19-4976-b1a4-b810ddd79c90 tempest-ServerRescueNegativeTestJSON-1109232221 None] Deleted volume successfully. Jul 24 09:38:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3e4c3f30-8a19-4976-b1a4-b810ddd79c90 tempest-ServerRescueNegativeTestJSON-1109232221 None] Lock "cinder-0caff34a-f397-445e-bc07-fbaef91fdbf1-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:38:04 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-413dd6c8-dfe3-4810-83fc-b543ac736b63 tempest-TaggedAttachmentsTest-999220636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-187b200e-0252-4b84-96d9-a5364f292918" returned: 0 in 1.111s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-413dd6c8-dfe3-4810-83fc-b543ac736b63 tempest-TaggedAttachmentsTest-999220636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-187b200e-0252-4b84-96d9-a5364f292918 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:04 devstack sudo[91397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-187b200e-0252-4b84-96d9-a5364f292918 Jul 24 09:38:04 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:05 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-413dd6c8-dfe3-4810-83fc-b543ac736b63 tempest-TaggedAttachmentsTest-999220636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-187b200e-0252-4b84-96d9-a5364f292918" returned: 0 in 0.532s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-413dd6c8-dfe3-4810-83fc-b543ac736b63 tempest-TaggedAttachmentsTest-999220636 None] Lock "cinder-quobyte-187b200e-0252-4b84-96d9-a5364f292918" released by "delete_volume" :: held 1.857s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:38:05 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-413dd6c8-dfe3-4810-83fc-b543ac736b63 tempest-TaggedAttachmentsTest-999220636 None] Created reservations ['4041dc8b-f1ba-467c-9c5c-a86b833d4a86', '0ef52eea-6c73-49f6-912a-3a8763701dfe', '6b36413a-d2a7-4db0-84be-ac4b32b5f5f8', 'b351c626-1692-4d77-934b-ab485e469d7e'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:38:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-413dd6c8-dfe3-4810-83fc-b543ac736b63 tempest-TaggedAttachmentsTest-999220636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:38:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-413dd6c8-dfe3-4810-83fc-b543ac736b63 tempest-TaggedAttachmentsTest-999220636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:38:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-413dd6c8-dfe3-4810-83fc-b543ac736b63 tempest-TaggedAttachmentsTest-999220636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:38:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-413dd6c8-dfe3-4810-83fc-b543ac736b63 tempest-TaggedAttachmentsTest-999220636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:38:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-413dd6c8-dfe3-4810-83fc-b543ac736b63 tempest-TaggedAttachmentsTest-999220636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:38:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-413dd6c8-dfe3-4810-83fc-b543ac736b63 tempest-TaggedAttachmentsTest-999220636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:05 devstack sudo[91409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:38:05 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:06 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-413dd6c8-dfe3-4810-83fc-b543ac736b63 tempest-TaggedAttachmentsTest-999220636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.695s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:06 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-413dd6c8-dfe3-4810-83fc-b543ac736b63 tempest-TaggedAttachmentsTest-999220636 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:38:06 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-413dd6c8-dfe3-4810-83fc-b543ac736b63 tempest-TaggedAttachmentsTest-999220636 None] Deleted volume successfully. Jul 24 09:38:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-413dd6c8-dfe3-4810-83fc-b543ac736b63 tempest-TaggedAttachmentsTest-999220636 None] Lock "cinder-187b200e-0252-4b84-96d9-a5364f292918-delete_volume" released by "delete_volume" :: held 3.383s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Flow 'volume_create_manager' (045827dd-ed3c-4056-bb85-333b5be34c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad212384-9335-45e1-963d-92c41f2e399f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad212384-9335-45e1-963d-92c41f2e399f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-583882076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f729736e-7f84-400a-b3bd-8f569dcd262c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6172cc26a5b843b38698f0ec9393e271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:38:11Z,use_quota=True,user_id='79162262ce5e4e1da47b814a8a566071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a25ab9-1f9b-4fcb-bd1a-acaa3e561a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a25ab9-1f9b-4fcb-bd1a-acaa3e561a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25f0809-d441-41ae-acc4-5030661aa2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25f0809-d441-41ae-acc4-5030661aa2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f729736e-7f84-400a-b3bd-8f569dcd262c', 'volume_name': 'volume-f729736e-7f84-400a-b3bd-8f569dcd262c', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f17ffc9-b12a-4db8-8759-5513cb90b154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f17ffc9-b12a-4db8-8759-5513cb90b154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1001b0-c514-4a23-a80f-2a1ff47c1bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:11 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Volume f729736e-7f84-400a-b3bd-8f569dcd262c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f729736e-7f84-400a-b3bd-8f569dcd262c', 'volume_size': 1} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-583882076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f729736e-7f84-400a-b3bd-8f569dcd262c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6172cc26a5b843b38698f0ec9393e271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:38:11Z,use_quota=True,user_id='79162262ce5e4e1da47b814a8a566071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Creating volume f729736e-7f84-400a-b3bd-8f569dcd262c {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:38:11 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:38:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f729736e-7f84-400a-b3bd-8f569dcd262c 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:11 devstack sudo[91480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f729736e-7f84-400a-b3bd-8f569dcd262c 1073741824 Jul 24 09:38:11 devstack sudo[91480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:12 devstack sudo[91480]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f729736e-7f84-400a-b3bd-8f569dcd262c 1073741824" returned: 0 in 0.881s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f729736e-7f84-400a-b3bd-8f569dcd262c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:12 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f729736e-7f84-400a-b3bd-8f569dcd262c Jul 24 09:38:12 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:13 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f729736e-7f84-400a-b3bd-8f569dcd262c" returned: 0 in 0.368s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:38:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:38:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1001b0-c514-4a23-a80f-2a1ff47c1bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f729736e-7f84-400a-b3bd-8f569dcd262c', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcaf2058-009c-46da-b6df-a6d58d690408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:13 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Volume volume-f729736e-7f84-400a-b3bd-8f569dcd262c (f729736e-7f84-400a-b3bd-8f569dcd262c): created successfully Jul 24 09:38:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcaf2058-009c-46da-b6df-a6d58d690408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Flow 'volume_create_manager' (045827dd-ed3c-4056-bb85-333b5be34c54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:38:13 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-782e4ed4-710b-4984-90da-eb54dd382438 tempest-ServersNegativeTestJSON-1782553524 None] Created volume successfully. Jul 24 09:38:14 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:38:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:38:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:38:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:38:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:38:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:38:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:15 devstack sudo[91595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:38:15 devstack sudo[91595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:15 devstack sudo[91595]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.717s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:38:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:38:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 8 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:38:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Flow 'volume_create_manager' (49fe5a97-db41-451c-bafd-b36795526065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b57d37-141b-48ac-9355-b17ceb57843d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b57d37-141b-48ac-9355-b17ceb57843d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-740776301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6172cc26a5b843b38698f0ec9393e271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:38:19Z,use_quota=True,user_id='79162262ce5e4e1da47b814a8a566071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea713c90-6fe4-48c9-96a3-32fc93cd950c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea713c90-6fe4-48c9-96a3-32fc93cd950c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b205bf63-0a8d-4eff-a002-a01b0b68d314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b205bf63-0a8d-4eff-a002-a01b0b68d314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4', 'volume_name': 'volume-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093801ad-017f-443f-a2cb-9a2fccac1044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093801ad-017f-443f-a2cb-9a2fccac1044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eff23d6-639d-4939-b142-7ac6928c874b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:18 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Volume 6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4', 'volume_size': 1} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-740776301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6172cc26a5b843b38698f0ec9393e271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:38:19Z,use_quota=True,user_id='79162262ce5e4e1da47b814a8a566071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Creating volume 6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:38:18 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:38:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:18 devstack sudo[91638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4 1073741824 Jul 24 09:38:18 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:19 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4 1073741824" returned: 0 in 0.568s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:19 devstack sudo[91644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4 Jul 24 09:38:19 devstack sudo[91644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:19 devstack sudo[91644]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4" returned: 0 in 0.530s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:38:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:38:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eff23d6-639d-4939-b142-7ac6928c874b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b685f4-b850-46fb-9fe9-5a8c83c0ee51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:20 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Volume volume-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4 (6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4): created successfully Jul 24 09:38:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b685f4-b850-46fb-9fe9-5a8c83c0ee51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Flow 'volume_create_manager' (49fe5a97-db41-451c-bafd-b36795526065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:38:20 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-61e485b2-a8a7-45f5-9c4a-8986400b680d tempest-ServersNegativeTestJSON-1782553524 None] Created volume successfully. Jul 24 09:38:21 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-507ec2c5-52c4-49b7-ad8b-1b1d00cfc6a5 tempest-ServersNegativeTestJSON-1782553524 None] Acquiring lock "cinder-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:38:21 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-507ec2c5-52c4-49b7-ad8b-1b1d00cfc6a5 tempest-ServersNegativeTestJSON-1782553524 None] Lock "cinder-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:38:21 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-507ec2c5-52c4-49b7-ad8b-1b1d00cfc6a5 tempest-ServersNegativeTestJSON-1782553524 None] Acquiring lock "cinder-quobyte-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:38:21 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-507ec2c5-52c4-49b7-ad8b-1b1d00cfc6a5 tempest-ServersNegativeTestJSON-1782553524 None] Lock "cinder-quobyte-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4" acquired by "delete_volume" :: waited 0.035s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:38:22 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[00764eb1-ff4b-4fc7-8d5c-675c91be1463]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:38:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-507ec2c5-52c4-49b7-ad8b-1b1d00cfc6a5 tempest-ServersNegativeTestJSON-1782553524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:22 devstack sudo[91652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4 Jul 24 09:38:22 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:22 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-507ec2c5-52c4-49b7-ad8b-1b1d00cfc6a5 tempest-ServersNegativeTestJSON-1782553524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4" returned: 0 in 0.672s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-507ec2c5-52c4-49b7-ad8b-1b1d00cfc6a5 tempest-ServersNegativeTestJSON-1782553524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:22 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4 Jul 24 09:38:22 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:23 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-507ec2c5-52c4-49b7-ad8b-1b1d00cfc6a5 tempest-ServersNegativeTestJSON-1782553524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4" returned: 0 in 0.352s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-507ec2c5-52c4-49b7-ad8b-1b1d00cfc6a5 tempest-ServersNegativeTestJSON-1782553524 None] Lock "cinder-quobyte-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4" released by "delete_volume" :: held 1.102s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:38:23 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-507ec2c5-52c4-49b7-ad8b-1b1d00cfc6a5 tempest-ServersNegativeTestJSON-1782553524 None] Created reservations ['4385f282-fe0b-4985-b6fa-e09e51d3c6d6', '37cac530-a677-460d-a976-1d6657932fa3', '1244d846-0d90-4136-93e1-e2e965af1c56', '251d3e66-52af-4e55-abab-e5e4471c7e52'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:38:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-507ec2c5-52c4-49b7-ad8b-1b1d00cfc6a5 tempest-ServersNegativeTestJSON-1782553524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:38:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-507ec2c5-52c4-49b7-ad8b-1b1d00cfc6a5 tempest-ServersNegativeTestJSON-1782553524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:38:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-507ec2c5-52c4-49b7-ad8b-1b1d00cfc6a5 tempest-ServersNegativeTestJSON-1782553524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:38:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-507ec2c5-52c4-49b7-ad8b-1b1d00cfc6a5 tempest-ServersNegativeTestJSON-1782553524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:38:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-507ec2c5-52c4-49b7-ad8b-1b1d00cfc6a5 tempest-ServersNegativeTestJSON-1782553524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:38:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-507ec2c5-52c4-49b7-ad8b-1b1d00cfc6a5 tempest-ServersNegativeTestJSON-1782553524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:23 devstack sudo[91662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:38:23 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:23 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-507ec2c5-52c4-49b7-ad8b-1b1d00cfc6a5 tempest-ServersNegativeTestJSON-1782553524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.320s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:23 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-507ec2c5-52c4-49b7-ad8b-1b1d00cfc6a5 tempest-ServersNegativeTestJSON-1782553524 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:38:23 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-507ec2c5-52c4-49b7-ad8b-1b1d00cfc6a5 tempest-ServersNegativeTestJSON-1782553524 None] Deleted volume successfully. Jul 24 09:38:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-507ec2c5-52c4-49b7-ad8b-1b1d00cfc6a5 tempest-ServersNegativeTestJSON-1782553524 None] Lock "cinder-6dd5d1cb-8820-4775-8b8b-e0910f5e4bb4-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:38:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1003fcfd-4a5c-4d70-b893-7298ac82330e tempest-ServersNegativeTestJSON-1782553524 None] Acquiring lock "cinder-f729736e-7f84-400a-b3bd-8f569dcd262c-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:38:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1003fcfd-4a5c-4d70-b893-7298ac82330e tempest-ServersNegativeTestJSON-1782553524 None] Lock "cinder-f729736e-7f84-400a-b3bd-8f569dcd262c-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:38:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1003fcfd-4a5c-4d70-b893-7298ac82330e tempest-ServersNegativeTestJSON-1782553524 None] Acquiring lock "cinder-quobyte-f729736e-7f84-400a-b3bd-8f569dcd262c" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:38:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1003fcfd-4a5c-4d70-b893-7298ac82330e tempest-ServersNegativeTestJSON-1782553524 None] Lock "cinder-quobyte-f729736e-7f84-400a-b3bd-8f569dcd262c" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:38:24 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7b34a2-74a3-4b17-b1c6-c90a8fb65a33]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:38:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1003fcfd-4a5c-4d70-b893-7298ac82330e tempest-ServersNegativeTestJSON-1782553524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f729736e-7f84-400a-b3bd-8f569dcd262c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:24 devstack sudo[91666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f729736e-7f84-400a-b3bd-8f569dcd262c Jul 24 09:38:24 devstack sudo[91666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:25 devstack sudo[91666]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1003fcfd-4a5c-4d70-b893-7298ac82330e tempest-ServersNegativeTestJSON-1782553524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f729736e-7f84-400a-b3bd-8f569dcd262c" returned: 0 in 0.469s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1003fcfd-4a5c-4d70-b893-7298ac82330e tempest-ServersNegativeTestJSON-1782553524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f729736e-7f84-400a-b3bd-8f569dcd262c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:25 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f729736e-7f84-400a-b3bd-8f569dcd262c Jul 24 09:38:25 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:25 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1003fcfd-4a5c-4d70-b893-7298ac82330e tempest-ServersNegativeTestJSON-1782553524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f729736e-7f84-400a-b3bd-8f569dcd262c" returned: 0 in 0.383s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1003fcfd-4a5c-4d70-b893-7298ac82330e tempest-ServersNegativeTestJSON-1782553524 None] Lock "cinder-quobyte-f729736e-7f84-400a-b3bd-8f569dcd262c" released by "delete_volume" :: held 0.919s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:38:25 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-1003fcfd-4a5c-4d70-b893-7298ac82330e tempest-ServersNegativeTestJSON-1782553524 None] Created reservations ['25c5d26a-f1b0-4675-9c48-97c207741a5a', '3e1e3cbb-b04f-4290-86d5-51b8750380aa', '4b137aa3-e5ae-4167-bb47-5b65b6e88a50', '480ed22e-5c0a-4b0e-b5b1-e0405a9aa553'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:38:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1003fcfd-4a5c-4d70-b893-7298ac82330e tempest-ServersNegativeTestJSON-1782553524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:38:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1003fcfd-4a5c-4d70-b893-7298ac82330e tempest-ServersNegativeTestJSON-1782553524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:38:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1003fcfd-4a5c-4d70-b893-7298ac82330e tempest-ServersNegativeTestJSON-1782553524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:38:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1003fcfd-4a5c-4d70-b893-7298ac82330e tempest-ServersNegativeTestJSON-1782553524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:38:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1003fcfd-4a5c-4d70-b893-7298ac82330e tempest-ServersNegativeTestJSON-1782553524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:38:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1003fcfd-4a5c-4d70-b893-7298ac82330e tempest-ServersNegativeTestJSON-1782553524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:25 devstack sudo[91675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:38:25 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:25 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1003fcfd-4a5c-4d70-b893-7298ac82330e tempest-ServersNegativeTestJSON-1782553524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.342s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:25 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-1003fcfd-4a5c-4d70-b893-7298ac82330e tempest-ServersNegativeTestJSON-1782553524 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:38:25 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-1003fcfd-4a5c-4d70-b893-7298ac82330e tempest-ServersNegativeTestJSON-1782553524 None] Deleted volume successfully. Jul 24 09:38:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1003fcfd-4a5c-4d70-b893-7298ac82330e tempest-ServersNegativeTestJSON-1782553524 None] Lock "cinder-f729736e-7f84-400a-b3bd-8f569dcd262c-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:38:35 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=38,cinder:SELECT=22,cinder:INSERT=11,cinder:DELETE=2 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:38:36 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=26,cinder:INSERT=7,cinder:UPDATE=38,cinder:DELETE=4 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Flow 'volume_create_manager' (97752d4e-3190-490e-a9e5-e1800ee6b973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d68a94-e554-49c2-80fe-13dff862acce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d68a94-e554-49c2-80fe-13dff862acce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-731331144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b8e121-9763-4a29-ab98-9c98969900e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f7ca43b1d7646efa9cfee84f514493d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:38:44Z,use_quota=True,user_id='759a1872f2474742907e47c4adf5380e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f28937b0-d661-411e-a7a1-4d9a5fbf93b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f28937b0-d661-411e-a7a1-4d9a5fbf93b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c094c5-f401-45f6-a833-9288d83796db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c094c5-f401-45f6-a833-9288d83796db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0b8e121-9763-4a29-ab98-9c98969900e4', 'volume_name': 'volume-f0b8e121-9763-4a29-ab98-9c98969900e4', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d85643-8ec7-431f-b4da-c02404013d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d85643-8ec7-431f-b4da-c02404013d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c5ba2d-0905-4fd9-8ff0-61e1e77b1b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:44 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Volume f0b8e121-9763-4a29-ab98-9c98969900e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0b8e121-9763-4a29-ab98-9c98969900e4', 'volume_size': 1} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-731331144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b8e121-9763-4a29-ab98-9c98969900e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f7ca43b1d7646efa9cfee84f514493d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:38:44Z,use_quota=True,user_id='759a1872f2474742907e47c4adf5380e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Creating volume f0b8e121-9763-4a29-ab98-9c98969900e4 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:38:44 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:38:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f0b8e121-9763-4a29-ab98-9c98969900e4 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:44 devstack sudo[91743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f0b8e121-9763-4a29-ab98-9c98969900e4 1073741824 Jul 24 09:38:44 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:45 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f0b8e121-9763-4a29-ab98-9c98969900e4 1073741824" returned: 0 in 0.763s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f0b8e121-9763-4a29-ab98-9c98969900e4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:45 devstack sudo[91752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f0b8e121-9763-4a29-ab98-9c98969900e4 Jul 24 09:38:45 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:45 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f0b8e121-9763-4a29-ab98-9c98969900e4" returned: 0 in 0.345s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:38:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:38:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c5ba2d-0905-4fd9-8ff0-61e1e77b1b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0b8e121-9763-4a29-ab98-9c98969900e4', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2349dc7-d7ec-4607-a3e7-ff1c6929d723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:45 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Volume volume-f0b8e121-9763-4a29-ab98-9c98969900e4 (f0b8e121-9763-4a29-ab98-9c98969900e4): created successfully Jul 24 09:38:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2349dc7-d7ec-4607-a3e7-ff1c6929d723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Flow 'volume_create_manager' (97752d4e-3190-490e-a9e5-e1800ee6b973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:38:45 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-678b8d4f-5e8d-4bd0-aa9c-7df28c4ebf95 tempest-ServerActionsTestOtherA-455552038 None] Created volume successfully. Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Flow 'volume_create_manager' (8e381f1f-441e-437a-a9f2-395ca1bbd932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d21361f-93d2-4d30-b745-41251d17dcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d21361f-93d2-4d30-b745-41251d17dcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-289761572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95849bbd-9148-4f3e-8110-20594e443f9c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cac0b9f2b9f4bb399e19adc4263808a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:38:47Z,use_quota=True,user_id='9b7b940f719f424fa34bb9c7bbd93a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30422a80-3364-46aa-812a-f6b21894aad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30422a80-3364-46aa-812a-f6b21894aad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab1509b-c2cb-4d9b-b669-42ba82cc1ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab1509b-c2cb-4d9b-b669-42ba82cc1ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95849bbd-9148-4f3e-8110-20594e443f9c', 'volume_name': 'volume-95849bbd-9148-4f3e-8110-20594e443f9c', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda26688-56aa-4302-9354-c1f2d50c677f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda26688-56aa-4302-9354-c1f2d50c677f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648670af-dcc9-44dc-a857-7d3010340597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:46 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Volume 95849bbd-9148-4f3e-8110-20594e443f9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95849bbd-9148-4f3e-8110-20594e443f9c', 'volume_size': 1} Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-289761572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95849bbd-9148-4f3e-8110-20594e443f9c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cac0b9f2b9f4bb399e19adc4263808a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:38:47Z,use_quota=True,user_id='9b7b940f719f424fa34bb9c7bbd93a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Creating volume 95849bbd-9148-4f3e-8110-20594e443f9c {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:38:46 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:38:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-95849bbd-9148-4f3e-8110-20594e443f9c 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:46 devstack sudo[91775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-95849bbd-9148-4f3e-8110-20594e443f9c 1073741824 Jul 24 09:38:46 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:47 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-95849bbd-9148-4f3e-8110-20594e443f9c 1073741824" returned: 0 in 0.602s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-95849bbd-9148-4f3e-8110-20594e443f9c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:47 devstack sudo[91786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-95849bbd-9148-4f3e-8110-20594e443f9c Jul 24 09:38:47 devstack sudo[91786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:47 devstack sudo[91786]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-95849bbd-9148-4f3e-8110-20594e443f9c" returned: 0 in 0.319s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:38:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:38:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648670af-dcc9-44dc-a857-7d3010340597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95849bbd-9148-4f3e-8110-20594e443f9c', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc05c94e-e752-4eef-b435-966d012e6046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:47 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Volume volume-95849bbd-9148-4f3e-8110-20594e443f9c (95849bbd-9148-4f3e-8110-20594e443f9c): created successfully Jul 24 09:38:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc05c94e-e752-4eef-b435-966d012e6046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Flow 'volume_create_manager' (8e381f1f-441e-437a-a9f2-395ca1bbd932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:38:47 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-6cdb8011-14ef-4cb5-9c73-1d7e97394aca tempest-VolumesTestJSON-1734480390 None] Created volume successfully. Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Flow 'volume_create_manager' (5029a9b1-1c4b-4a50-830f-b04bea9b1bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527a200d-53fb-4e26-bdc0-28cded413057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527a200d-53fb-4e26-bdc0-28cded413057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-366470831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5655b20a-0849-4cc5-9d0c-393ccfe4fcc1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cac0b9f2b9f4bb399e19adc4263808a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:38:49Z,use_quota=True,user_id='9b7b940f719f424fa34bb9c7bbd93a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f92ae22-f57c-4489-87e0-dbd24eb812df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f92ae22-f57c-4489-87e0-dbd24eb812df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4426d1ca-bc3b-4965-bf6d-709a3c05f60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4426d1ca-bc3b-4965-bf6d-709a3c05f60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5655b20a-0849-4cc5-9d0c-393ccfe4fcc1', 'volume_name': 'volume-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fe9e72-fbd0-4539-9d17-1169ff0240fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fe9e72-fbd0-4539-9d17-1169ff0240fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e665fa7-ad82-4c71-898f-6c8c7e46a7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:49 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Volume 5655b20a-0849-4cc5-9d0c-393ccfe4fcc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1', 'volume_size': 1} Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-366470831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5655b20a-0849-4cc5-9d0c-393ccfe4fcc1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cac0b9f2b9f4bb399e19adc4263808a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:38:49Z,use_quota=True,user_id='9b7b940f719f424fa34bb9c7bbd93a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Creating volume 5655b20a-0849-4cc5-9d0c-393ccfe4fcc1 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:38:49 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:38:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:49 devstack sudo[91807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1 1073741824 Jul 24 09:38:49 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:50 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1 1073741824" returned: 0 in 0.486s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:50 devstack sudo[91816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1 Jul 24 09:38:50 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:50 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1" returned: 0 in 0.635s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:50 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:38:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:38:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e665fa7-ad82-4c71-898f-6c8c7e46a7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28823e64-b69b-4176-93dd-3b86aec69ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:50 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Volume volume-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1 (5655b20a-0849-4cc5-9d0c-393ccfe4fcc1): created successfully Jul 24 09:38:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28823e64-b69b-4176-93dd-3b86aec69ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Flow 'volume_create_manager' (5029a9b1-1c4b-4a50-830f-b04bea9b1bcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:38:50 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-0002e89c-2a04-492d-bd0d-e81c97a0b060 tempest-VolumesTestJSON-1734480390 None] Created volume successfully. Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Flow 'volume_create_manager' (c544cf2b-a0a4-4805-a6b7-a75c1d8079fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1423143f-d4b5-4a1c-8b7c-053b1e4535f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1423143f-d4b5-4a1c-8b7c-053b1e4535f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-297365751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee21b9e7-c071-4e67-b59b-0a01d9d772a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cac0b9f2b9f4bb399e19adc4263808a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:38:53Z,use_quota=True,user_id='9b7b940f719f424fa34bb9c7bbd93a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc681eb-cfc6-4a9f-a1e8-f61c84201df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc681eb-cfc6-4a9f-a1e8-f61c84201df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a380c23-0127-4c9e-a51e-4f74752ebaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a380c23-0127-4c9e-a51e-4f74752ebaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee21b9e7-c071-4e67-b59b-0a01d9d772a2', 'volume_name': 'volume-ee21b9e7-c071-4e67-b59b-0a01d9d772a2', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176c0ee0-d04e-4b41-a67f-b72e0f562c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176c0ee0-d04e-4b41-a67f-b72e0f562c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0807dbe-b69f-493a-8f16-6d5073cdaa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:53 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Volume ee21b9e7-c071-4e67-b59b-0a01d9d772a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee21b9e7-c071-4e67-b59b-0a01d9d772a2', 'volume_size': 1} Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-297365751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee21b9e7-c071-4e67-b59b-0a01d9d772a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cac0b9f2b9f4bb399e19adc4263808a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:38:53Z,use_quota=True,user_id='9b7b940f719f424fa34bb9c7bbd93a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Creating volume ee21b9e7-c071-4e67-b59b-0a01d9d772a2 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:38:53 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:38:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ee21b9e7-c071-4e67-b59b-0a01d9d772a2 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:53 devstack sudo[91954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ee21b9e7-c071-4e67-b59b-0a01d9d772a2 1073741824 Jul 24 09:38:53 devstack sudo[91954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:55 devstack sudo[91954]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ee21b9e7-c071-4e67-b59b-0a01d9d772a2 1073741824" returned: 0 in 1.520s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ee21b9e7-c071-4e67-b59b-0a01d9d772a2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:55 devstack sudo[92013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ee21b9e7-c071-4e67-b59b-0a01d9d772a2 Jul 24 09:38:55 devstack sudo[92013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:38:55 devstack sudo[92013]: pam_unix(sudo:session): session closed for user root Jul 24 09:38:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ee21b9e7-c071-4e67-b59b-0a01d9d772a2" returned: 0 in 0.599s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:38:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] <== create_volume: return (2229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:38:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.241s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:38:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0807dbe-b69f-493a-8f16-6d5073cdaa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee21b9e7-c071-4e67-b59b-0a01d9d772a2', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c605c9f2-1ba8-452d-a9a3-56948833ec08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:38:55 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Volume volume-ee21b9e7-c071-4e67-b59b-0a01d9d772a2 (ee21b9e7-c071-4e67-b59b-0a01d9d772a2): created successfully Jul 24 09:38:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c605c9f2-1ba8-452d-a9a3-56948833ec08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:38:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Flow 'volume_create_manager' (c544cf2b-a0a4-4805-a6b7-a75c1d8079fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:38:55 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-1fb3450a-19a1-4328-afec-cdda7a5a6cb2 tempest-VolumesTestJSON-1734480390 None] Created volume successfully. Jul 24 09:38:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-33f9190a-6765-4c3e-b78b-6510cbeda983 tempest-VolumesTestJSON-1734480390 None] Acquiring lock "cinder-ee21b9e7-c071-4e67-b59b-0a01d9d772a2-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:38:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-33f9190a-6765-4c3e-b78b-6510cbeda983 tempest-VolumesTestJSON-1734480390 None] Lock "cinder-ee21b9e7-c071-4e67-b59b-0a01d9d772a2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:38:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-33f9190a-6765-4c3e-b78b-6510cbeda983 tempest-VolumesTestJSON-1734480390 None] Acquiring lock "cinder-quobyte-ee21b9e7-c071-4e67-b59b-0a01d9d772a2" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:38:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-33f9190a-6765-4c3e-b78b-6510cbeda983 tempest-VolumesTestJSON-1734480390 None] Lock "cinder-quobyte-ee21b9e7-c071-4e67-b59b-0a01d9d772a2" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:38:59 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adbb644-1b3f-441d-9406-c2157d608188]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:38:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-33f9190a-6765-4c3e-b78b-6510cbeda983 tempest-VolumesTestJSON-1734480390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ee21b9e7-c071-4e67-b59b-0a01d9d772a2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:38:59 devstack sudo[92046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ee21b9e7-c071-4e67-b59b-0a01d9d772a2 Jul 24 09:38:59 devstack sudo[92046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:00 devstack sudo[92046]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-33f9190a-6765-4c3e-b78b-6510cbeda983 tempest-VolumesTestJSON-1734480390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ee21b9e7-c071-4e67-b59b-0a01d9d772a2" returned: 0 in 0.743s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-33f9190a-6765-4c3e-b78b-6510cbeda983 tempest-VolumesTestJSON-1734480390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ee21b9e7-c071-4e67-b59b-0a01d9d772a2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:00 devstack sudo[92059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ee21b9e7-c071-4e67-b59b-0a01d9d772a2 Jul 24 09:39:00 devstack sudo[92059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:00 devstack sudo[92059]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-33f9190a-6765-4c3e-b78b-6510cbeda983 tempest-VolumesTestJSON-1734480390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ee21b9e7-c071-4e67-b59b-0a01d9d772a2" returned: 0 in 0.594s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-33f9190a-6765-4c3e-b78b-6510cbeda983 tempest-VolumesTestJSON-1734480390 None] Lock "cinder-quobyte-ee21b9e7-c071-4e67-b59b-0a01d9d772a2" released by "delete_volume" :: held 1.445s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:39:00 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-33f9190a-6765-4c3e-b78b-6510cbeda983 tempest-VolumesTestJSON-1734480390 None] Created reservations ['6a3891f7-3846-4eba-90ae-eefcb6dfcaf0', '62c8d874-c54b-4f42-991d-c06c34000bd0', '5360629f-1ec5-4e1c-b91c-494e1d613c51', '7ff007b3-f47c-467a-8691-4b9082d8ffbb'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:39:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-33f9190a-6765-4c3e-b78b-6510cbeda983 tempest-VolumesTestJSON-1734480390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-33f9190a-6765-4c3e-b78b-6510cbeda983 tempest-VolumesTestJSON-1734480390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-33f9190a-6765-4c3e-b78b-6510cbeda983 tempest-VolumesTestJSON-1734480390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:39:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-33f9190a-6765-4c3e-b78b-6510cbeda983 tempest-VolumesTestJSON-1734480390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:39:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-33f9190a-6765-4c3e-b78b-6510cbeda983 tempest-VolumesTestJSON-1734480390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:39:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-33f9190a-6765-4c3e-b78b-6510cbeda983 tempest-VolumesTestJSON-1734480390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:01 devstack sudo[92088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:39:01 devstack sudo[92088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:01 devstack sudo[92088]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-33f9190a-6765-4c3e-b78b-6510cbeda983 tempest-VolumesTestJSON-1734480390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.664s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:01 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-33f9190a-6765-4c3e-b78b-6510cbeda983 tempest-VolumesTestJSON-1734480390 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:39:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-41794e84-ad6a-4721-8476-b81c986d4cfd tempest-VolumesTestJSON-1734480390 None] Acquiring lock "cinder-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:39:01 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-33f9190a-6765-4c3e-b78b-6510cbeda983 tempest-VolumesTestJSON-1734480390 None] Deleted volume successfully. Jul 24 09:39:02 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-41794e84-ad6a-4721-8476-b81c986d4cfd tempest-VolumesTestJSON-1734480390 None] Lock "cinder-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:39:02 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-33f9190a-6765-4c3e-b78b-6510cbeda983 tempest-VolumesTestJSON-1734480390 None] Lock "cinder-ee21b9e7-c071-4e67-b59b-0a01d9d772a2-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:39:02 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-41794e84-ad6a-4721-8476-b81c986d4cfd tempest-VolumesTestJSON-1734480390 None] Acquiring lock "cinder-quobyte-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:39:02 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-41794e84-ad6a-4721-8476-b81c986d4cfd tempest-VolumesTestJSON-1734480390 None] Lock "cinder-quobyte-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1" acquired by "delete_volume" :: waited 0.059s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:39:02 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f148bb54-b2b3-4442-939c-49008cee13a7]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:39:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-41794e84-ad6a-4721-8476-b81c986d4cfd tempest-VolumesTestJSON-1734480390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:02 devstack sudo[92096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1 Jul 24 09:39:02 devstack sudo[92096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:03 devstack sudo[92096]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-41794e84-ad6a-4721-8476-b81c986d4cfd tempest-VolumesTestJSON-1734480390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1" returned: 0 in 0.818s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-41794e84-ad6a-4721-8476-b81c986d4cfd tempest-VolumesTestJSON-1734480390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:03 devstack sudo[92101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1 Jul 24 09:39:03 devstack sudo[92101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:03 devstack sudo[92101]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-41794e84-ad6a-4721-8476-b81c986d4cfd tempest-VolumesTestJSON-1734480390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1" returned: 0 in 0.655s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-41794e84-ad6a-4721-8476-b81c986d4cfd tempest-VolumesTestJSON-1734480390 None] Lock "cinder-quobyte-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1" released by "delete_volume" :: held 1.621s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:39:03 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-41794e84-ad6a-4721-8476-b81c986d4cfd tempest-VolumesTestJSON-1734480390 None] Created reservations ['0e9e1a18-0526-4302-af68-b6d56eb749fd', 'f380f86c-6273-4d1e-8eb1-a1105edaab8b', '5bf79bab-2ace-49c5-b74a-046898f272e8', 'f5c247fe-c388-40c8-acd0-3acea985ae17'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:39:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-41794e84-ad6a-4721-8476-b81c986d4cfd tempest-VolumesTestJSON-1734480390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-41794e84-ad6a-4721-8476-b81c986d4cfd tempest-VolumesTestJSON-1734480390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-41794e84-ad6a-4721-8476-b81c986d4cfd tempest-VolumesTestJSON-1734480390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:39:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-41794e84-ad6a-4721-8476-b81c986d4cfd tempest-VolumesTestJSON-1734480390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:39:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-41794e84-ad6a-4721-8476-b81c986d4cfd tempest-VolumesTestJSON-1734480390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:39:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-41794e84-ad6a-4721-8476-b81c986d4cfd tempest-VolumesTestJSON-1734480390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:04 devstack sudo[92110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:39:04 devstack sudo[92110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-996cd276-2394-4893-9231-5cc197a9894f tempest-VolumesTestJSON-1734480390 None] Acquiring lock "cinder-95849bbd-9148-4f3e-8110-20594e443f9c-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:39:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-996cd276-2394-4893-9231-5cc197a9894f tempest-VolumesTestJSON-1734480390 None] Lock "cinder-95849bbd-9148-4f3e-8110-20594e443f9c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:39:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-996cd276-2394-4893-9231-5cc197a9894f tempest-VolumesTestJSON-1734480390 None] Acquiring lock "cinder-quobyte-95849bbd-9148-4f3e-8110-20594e443f9c" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:39:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-996cd276-2394-4893-9231-5cc197a9894f tempest-VolumesTestJSON-1734480390 None] Lock "cinder-quobyte-95849bbd-9148-4f3e-8110-20594e443f9c" acquired by "delete_volume" :: waited 0.037s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:39:04 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f833be-2625-4683-a460-d840b9f39040]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:39:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-996cd276-2394-4893-9231-5cc197a9894f tempest-VolumesTestJSON-1734480390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-95849bbd-9148-4f3e-8110-20594e443f9c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:04 devstack sudo[92110]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-41794e84-ad6a-4721-8476-b81c986d4cfd tempest-VolumesTestJSON-1734480390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.708s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:04 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-41794e84-ad6a-4721-8476-b81c986d4cfd tempest-VolumesTestJSON-1734480390 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:39:04 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-41794e84-ad6a-4721-8476-b81c986d4cfd tempest-VolumesTestJSON-1734480390 None] Deleted volume successfully. Jul 24 09:39:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-41794e84-ad6a-4721-8476-b81c986d4cfd tempest-VolumesTestJSON-1734480390 None] Lock "cinder-5655b20a-0849-4cc5-9d0c-393ccfe4fcc1-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:39:05 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-95849bbd-9148-4f3e-8110-20594e443f9c Jul 24 09:39:05 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:05 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-996cd276-2394-4893-9231-5cc197a9894f tempest-VolumesTestJSON-1734480390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-95849bbd-9148-4f3e-8110-20594e443f9c" returned: 0 in 0.514s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-996cd276-2394-4893-9231-5cc197a9894f tempest-VolumesTestJSON-1734480390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-95849bbd-9148-4f3e-8110-20594e443f9c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:05 devstack sudo[92120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-95849bbd-9148-4f3e-8110-20594e443f9c Jul 24 09:39:05 devstack sudo[92120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:05 devstack sudo[92120]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-996cd276-2394-4893-9231-5cc197a9894f tempest-VolumesTestJSON-1734480390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-95849bbd-9148-4f3e-8110-20594e443f9c" returned: 0 in 0.288s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-996cd276-2394-4893-9231-5cc197a9894f tempest-VolumesTestJSON-1734480390 None] Lock "cinder-quobyte-95849bbd-9148-4f3e-8110-20594e443f9c" released by "delete_volume" :: held 0.865s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:39:05 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-996cd276-2394-4893-9231-5cc197a9894f tempest-VolumesTestJSON-1734480390 None] Created reservations ['a7d46edf-c2e9-4055-98c1-806326b1cc52', '50f49c74-f5d3-4c87-bd13-7c4a515a5f97', '4750e313-54dc-4916-9eb7-6de2c50b68fd', 'bb1165b3-5172-4e10-baaf-d0f77904c409'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:39:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-996cd276-2394-4893-9231-5cc197a9894f tempest-VolumesTestJSON-1734480390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-996cd276-2394-4893-9231-5cc197a9894f tempest-VolumesTestJSON-1734480390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-996cd276-2394-4893-9231-5cc197a9894f tempest-VolumesTestJSON-1734480390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:39:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-996cd276-2394-4893-9231-5cc197a9894f tempest-VolumesTestJSON-1734480390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:39:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-996cd276-2394-4893-9231-5cc197a9894f tempest-VolumesTestJSON-1734480390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:39:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-996cd276-2394-4893-9231-5cc197a9894f tempest-VolumesTestJSON-1734480390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:05 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:39:05 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:06 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-996cd276-2394-4893-9231-5cc197a9894f tempest-VolumesTestJSON-1734480390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.530s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:06 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-996cd276-2394-4893-9231-5cc197a9894f tempest-VolumesTestJSON-1734480390 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:39:06 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-996cd276-2394-4893-9231-5cc197a9894f tempest-VolumesTestJSON-1734480390 None] Deleted volume successfully. Jul 24 09:39:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-996cd276-2394-4893-9231-5cc197a9894f tempest-VolumesTestJSON-1734480390 None] Lock "cinder-95849bbd-9148-4f3e-8110-20594e443f9c-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:39:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e80e9efc-bfb5-4cbc-b626-9e8a1fe49b51 tempest-BackendsCapabilitiesAdminTestsJSON-1227034724 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88488) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 24 09:39:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-531e9201-801f-4696-b55f-20239eac762b tempest-BackendsCapabilitiesAdminTestsJSON-1227034724 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88488) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 24 09:39:14 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:39:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:39:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:39:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:39:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:15 devstack sudo[92213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:39:15 devstack sudo[92213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:15 devstack sudo[92213]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.251s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:39:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:39:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 8 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:39:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:39:16 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-bfb745c7-238d-4dfe-bf18-62767bb95bee tempest-GroupSnapshotsV319Test-2121747091 None] Group tempest-GroupSnapshotsV319Test-Group-224362028: creating Jul 24 09:39:16 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-bfb745c7-238d-4dfe-bf18-62767bb95bee tempest-GroupSnapshotsV319Test-2121747091 None] Group tempest-GroupSnapshotsV319Test-Group-224362028: created successfully Jul 24 09:39:16 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-bfb745c7-238d-4dfe-bf18-62767bb95bee tempest-GroupSnapshotsV319Test-2121747091 None] Create group completed successfully. Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Flow 'volume_create_manager' (5dbce15d-510d-44dc-b47c-c2a26e6cb5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb6eba9-3b42-4d48-8ffb-c6eeb76e026d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb6eba9-3b42-4d48-8ffb-c6eeb76e026d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-91537927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=694580d1-ab8a-4353-8262-23ac84208d78,host='devstack@QuobyteHD#QuobyteHD',id=b01f7590-5a8b-4563-91b9-1730844eeeae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3a94777568408c9dc78217f75577f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:39:18Z,use_quota=True,user_id='e28e136324fb4bedbfe949f9f06f2367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98a43cca-c204-4080-bfcc-da038bdf81dc),volume_type_id=98a43cca-c204-4080-bfcc-da038bdf81dc)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3baa4ea0-f1c3-41ce-955a-876031b71226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3baa4ea0-f1c3-41ce-955a-876031b71226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1561cdad-ce8f-4751-95bd-f2db70fda6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1561cdad-ce8f-4751-95bd-f2db70fda6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b01f7590-5a8b-4563-91b9-1730844eeeae', 'volume_name': 'volume-b01f7590-5a8b-4563-91b9-1730844eeeae', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb74ee1-0946-488d-8c71-750475aab723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb74ee1-0946-488d-8c71-750475aab723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4b466a-536b-4758-9e75-302230d4da97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:18 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Volume b01f7590-5a8b-4563-91b9-1730844eeeae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b01f7590-5a8b-4563-91b9-1730844eeeae', 'volume_size': 1} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=694580d1-ab8a-4353-8262-23ac84208d78,created_at=2026-07-24T07:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-91537927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=694580d1-ab8a-4353-8262-23ac84208d78,host='devstack@QuobyteHD#QuobyteHD',id=b01f7590-5a8b-4563-91b9-1730844eeeae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3a94777568408c9dc78217f75577f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:39:18Z,use_quota=True,user_id='e28e136324fb4bedbfe949f9f06f2367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98a43cca-c204-4080-bfcc-da038bdf81dc),volume_type_id=98a43cca-c204-4080-bfcc-da038bdf81dc)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Creating volume b01f7590-5a8b-4563-91b9-1730844eeeae {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:39:18 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:18 devstack sudo[92252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae 1073741824 Jul 24 09:39:18 devstack sudo[92252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:18 devstack sudo[92252]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae 1073741824" returned: 0 in 0.429s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:18 devstack sudo[92280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae Jul 24 09:39:18 devstack sudo[92280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:19 devstack sudo[92280]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae" returned: 0 in 0.238s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:39:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:39:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4b466a-536b-4758-9e75-302230d4da97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b01f7590-5a8b-4563-91b9-1730844eeeae', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd496cbc-01f2-434b-a60e-32d7587a0af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:19 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Volume volume-b01f7590-5a8b-4563-91b9-1730844eeeae (b01f7590-5a8b-4563-91b9-1730844eeeae): created successfully Jul 24 09:39:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd496cbc-01f2-434b-a60e-32d7587a0af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Flow 'volume_create_manager' (5dbce15d-510d-44dc-b47c-c2a26e6cb5cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:39:19 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-a1435920-e3bd-44b2-9704-a8e49e00e145 tempest-GroupSnapshotsV319Test-2121747091 None] Created volume successfully. Jul 24 09:39:19 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] GroupSnapshot 04c95bcb-b6a8-4a94-9cde-95767296a96b: creating. Jul 24 09:39:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] Group snapshot 04c95bcb-b6a8-4a94-9cde-95767296a96b: creating. {{(pid=88488) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 24 09:39:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] Creating offline snapshot a8029ba5-3491-435d-8fcb-ece27f1c7bc5 of volume b01f7590-5a8b-4563-91b9-1730844eeeae {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:39:19 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[98239002-e096-4ea3-beef-e2991c944aa2]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:39:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:20 devstack sudo[92283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae Jul 24 09:39:20 devstack sudo[92283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:20 devstack sudo[92283]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae" returned: 0 in 0.361s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.a8029ba5-3491-435d-8fcb-ece27f1c7bc5 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:20 devstack sudo[92288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.a8029ba5-3491-435d-8fcb-ece27f1c7bc5 1G Jul 24 09:39:20 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:20 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.a8029ba5-3491-435d-8fcb-ece27f1c7bc5 1G" returned: 0 in 0.403s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01f7590-5a8b-4563-91b9-1730844eeeae -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.a8029ba5-3491-435d-8fcb-ece27f1c7bc5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:20 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01f7590-5a8b-4563-91b9-1730844eeeae -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.a8029ba5-3491-435d-8fcb-ece27f1c7bc5 Jul 24 09:39:20 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:21 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01f7590-5a8b-4563-91b9-1730844eeeae -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.a8029ba5-3491-435d-8fcb-ece27f1c7bc5" returned: 0 in 0.338s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:21 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.a8029ba5-3491-435d-8fcb-ece27f1c7bc5 is being set with open permissions: ugo+rw: NotImplementedError Jul 24 09:39:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.a8029ba5-3491-435d-8fcb-ece27f1c7bc5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:21 devstack sudo[92298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.a8029ba5-3491-435d-8fcb-ece27f1c7bc5 Jul 24 09:39:21 devstack sudo[92298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:21 devstack sudo[92298]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.a8029ba5-3491-435d-8fcb-ece27f1c7bc5" returned: 0 in 0.248s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:21 devstack sudo[92301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.info Jul 24 09:39:21 devstack sudo[92301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:21 devstack sudo[92301]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.info" returned: 0 in 0.252s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:21 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 09:39:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:21 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.info Jul 24 09:39:21 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:21 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.info" returned: 0 in 0.260s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.947s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:39:21 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c3cb9d1d-a0a1-4fc6-aa0e-6ac9b8633bc5 tempest-GroupSnapshotsV319Test-2121747091 None] group_snapshot 04c95bcb-b6a8-4a94-9cde-95767296a96b: created successfully Jul 24 09:39:22 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] group_snapshot 04c95bcb-b6a8-4a94-9cde-95767296a96b: deleting Jul 24 09:39:22 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] group_snapshot 04c95bcb-b6a8-4a94-9cde-95767296a96b: deleting {{(pid=88488) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 24 09:39:22 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] Acquiring lock "cinder-quobyte-b01f7590-5a8b-4563-91b9-1730844eeeae" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:39:22 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] Lock "cinder-quobyte-b01f7590-5a8b-4563-91b9-1730844eeeae" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:39:22 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] Acquiring lock "cinder-quobyte-a8029ba5-3491-435d-8fcb-ece27f1c7bc5" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:39:22 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] Lock "cinder-quobyte-a8029ba5-3491-435d-8fcb-ece27f1c7bc5" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:39:22 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] Deleting offline snapshot a8029ba5-3491-435d-8fcb-ece27f1c7bc5 of volume b01f7590-5a8b-4563-91b9-1730844eeeae {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:39:22 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] snapshot_file for this snap is: volume-b01f7590-5a8b-4563-91b9-1730844eeeae.a8029ba5-3491-435d-8fcb-ece27f1c7bc5 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:39:22 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[63112f65-bc8d-4e18-bba5-2ac47a5ab8fc]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:39:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.a8029ba5-3491-435d-8fcb-ece27f1c7bc5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:22 devstack sudo[92308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.a8029ba5-3491-435d-8fcb-ece27f1c7bc5 Jul 24 09:39:22 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:22 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.a8029ba5-3491-435d-8fcb-ece27f1c7bc5" returned: 0 in 0.357s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:22 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b01f7590-5a8b-4563-91b9-1730844eeeae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:39:22 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccc05b2-096f-45dd-8d54-fd6b03a873f4]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:39:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:23 devstack sudo[92315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae Jul 24 09:39:23 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:23 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae" returned: 0 in 0.369s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.a8029ba5-3491-435d-8fcb-ece27f1c7bc5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:23 devstack sudo[92321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.a8029ba5-3491-435d-8fcb-ece27f1c7bc5 Jul 24 09:39:23 devstack sudo[92321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Flow 'volume_create_manager' (3e62113d-71a9-4b58-bb87-876589b5def8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb000112-6dc8-48f8-be69-9df177f74693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb000112-6dc8-48f8-be69-9df177f74693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-345133671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6714f26b-22a9-40d2-a530-2745b25b3024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1580e98c9b4578a32eb24ec7885713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:39:24Z,use_quota=True,user_id='ba7b5c7a8deb4bbbbf3677ad360e3bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0540781-d148-4e9c-88db-8f8a7c8ab685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0540781-d148-4e9c-88db-8f8a7c8ab685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f785500e-8556-4023-9f8c-6b6835075a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f785500e-8556-4023-9f8c-6b6835075a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6714f26b-22a9-40d2-a530-2745b25b3024', 'volume_name': 'volume-6714f26b-22a9-40d2-a530-2745b25b3024', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1bd973-c03e-447a-9623-2bcb140ae7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1bd973-c03e-447a-9623-2bcb140ae7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c7dfb3-452b-4bf0-bbb7-01b58f65553e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:23 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Volume 6714f26b-22a9-40d2-a530-2745b25b3024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6714f26b-22a9-40d2-a530-2745b25b3024', 'volume_size': 1} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-345133671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6714f26b-22a9-40d2-a530-2745b25b3024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1580e98c9b4578a32eb24ec7885713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:39:24Z,use_quota=True,user_id='ba7b5c7a8deb4bbbbf3677ad360e3bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Creating volume 6714f26b-22a9-40d2-a530-2745b25b3024 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:39:23 devstack sudo[92321]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:39:23 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6714f26b-22a9-40d2-a530-2745b25b3024 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.a8029ba5-3491-435d-8fcb-ece27f1c7bc5" returned: 0 in 0.373s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.a8029ba5-3491-435d-8fcb-ece27f1c7bc5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:23 devstack sudo[92327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6714f26b-22a9-40d2-a530-2745b25b3024 1073741824 Jul 24 09:39:23 devstack sudo[92327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:23 devstack sudo[92328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.a8029ba5-3491-435d-8fcb-ece27f1c7bc5 Jul 24 09:39:23 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:23 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae.a8029ba5-3491-435d-8fcb-ece27f1c7bc5" returned: 0 in 0.243s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] Lock "cinder-quobyte-a8029ba5-3491-435d-8fcb-ece27f1c7bc5" released by "_delete_snapshot" :: held 1.460s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] Lock "cinder-quobyte-b01f7590-5a8b-4563-91b9-1730844eeeae" released by "delete_snapshot" :: held 1.480s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:39:24 devstack cinder-volume[88488]: WARNING cinder.quota [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1631334812 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1631334812, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:39:24 devstack cinder-volume[88488]: WARNING cinder.quota [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1631334812 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1631334812, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] Created reservations ['4fbf33d3-d966-403f-8f60-108582ac30d1', '68d0158c-3b0e-490c-8a67-08e7e4bb546b', 'ec5693fa-bf6c-4075-8d04-02a550316663', 'd2e378c0-c1f0-481a-890b-111f874cea08'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:39:24 devstack sudo[92327]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6714f26b-22a9-40d2-a530-2745b25b3024 1073741824" returned: 0 in 0.467s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:24 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-dc94944c-1901-4f1d-9d3d-22e23197686f tempest-GroupSnapshotsV319Test-2121747091 None] group_snapshot 04c95bcb-b6a8-4a94-9cde-95767296a96b: deleted successfully Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6714f26b-22a9-40d2-a530-2745b25b3024 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:24 devstack sudo[92337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6714f26b-22a9-40d2-a530-2745b25b3024 Jul 24 09:39:24 devstack sudo[92337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:24 devstack sudo[92337]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6714f26b-22a9-40d2-a530-2745b25b3024" returned: 0 in 0.261s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c7dfb3-452b-4bf0-bbb7-01b58f65553e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6714f26b-22a9-40d2-a530-2745b25b3024', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f820d7-aed9-4fd7-8583-4c08603494e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:24 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Volume volume-6714f26b-22a9-40d2-a530-2745b25b3024 (6714f26b-22a9-40d2-a530-2745b25b3024): created successfully Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f820d7-aed9-4fd7-8583-4c08603494e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Flow 'volume_create_manager' (3e62113d-71a9-4b58-bb87-876589b5def8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:39:24 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-abb00f40-9b4a-4ba7-ba32-e94d4121195b tempest-AttachVolumeNegativeTest-98594709 None] Created volume successfully. Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Flow 'volume_create_manager' (979ec251-4b03-4603-9905-828cf76c6a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8033dc0-0c9b-406b-b435-d0a39dba8c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8033dc0-0c9b-406b-b435-d0a39dba8c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1729796328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fb393f69e7408bb60c7f076fd01136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:39:25Z,use_quota=True,user_id='da5d9dea5b0e480a975c6fbeac62484b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6334ad9-2962-4cdf-bf55-2d14ee91ff48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6334ad9-2962-4cdf-bf55-2d14ee91ff48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebfcd36-1efa-4407-84e9-eb61500711ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebfcd36-1efa-4407-84e9-eb61500711ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef', 'volume_name': 'volume-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d59ef48-a7a0-4c5e-ab70-49aff5755eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d59ef48-a7a0-4c5e-ab70-49aff5755eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a26f7a7-bfd5-46d4-90be-98faf59eb0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:24 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Volume cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef', 'volume_size': 1} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1729796328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fb393f69e7408bb60c7f076fd01136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:39:25Z,use_quota=True,user_id='da5d9dea5b0e480a975c6fbeac62484b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Creating volume cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:39:24 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:39:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:24 devstack sudo[92344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef 1073741824 Jul 24 09:39:24 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a12824c7-78ed-4727-a888-67e19c0c48e2 tempest-GroupSnapshotsV319Test-2121747091 None] Acquiring lock "cinder-quobyte-b01f7590-5a8b-4563-91b9-1730844eeeae" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a12824c7-78ed-4727-a888-67e19c0c48e2 tempest-GroupSnapshotsV319Test-2121747091 None] Lock "cinder-quobyte-b01f7590-5a8b-4563-91b9-1730844eeeae" acquired by "delete_volume" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[197be50b-bcf9-49ba-8d45-198451a218d6]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a12824c7-78ed-4727-a888-67e19c0c48e2 tempest-GroupSnapshotsV319Test-2121747091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:25 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae Jul 24 09:39:25 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:25 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef 1073741824" returned: 0 in 0.555s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-2dc01992-6312-4708-9875-84c9e38f7b43 req-86616c27-dcb6-44c7-90de-3086c70416e1 tempest-AttachVolumeNegativeTest-98594709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:25 devstack sudo[92360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef Jul 24 09:39:25 devstack sudo[92360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:25 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a12824c7-78ed-4727-a888-67e19c0c48e2 tempest-GroupSnapshotsV319Test-2121747091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae" returned: 0 in 0.370s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a12824c7-78ed-4727-a888-67e19c0c48e2 tempest-GroupSnapshotsV319Test-2121747091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:25 devstack sudo[92365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae Jul 24 09:39:25 devstack sudo[92365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:25 devstack sudo[92360]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef" returned: 0 in 0.259s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-2dc01992-6312-4708-9875-84c9e38f7b43 req-86616c27-dcb6-44c7-90de-3086c70416e1 tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.276s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-2dc01992-6312-4708-9875-84c9e38f7b43 req-86616c27-dcb6-44c7-90de-3086c70416e1 tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a26f7a7-bfd5-46d4-90be-98faf59eb0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (761101dc-8232-4704-95b5-d4813380262b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:25 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Volume volume-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef (cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef): created successfully Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (761101dc-8232-4704-95b5-d4813380262b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Flow 'volume_create_manager' (979ec251-4b03-4603-9905-828cf76c6a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-2dc01992-6312-4708-9875-84c9e38f7b43 req-86616c27-dcb6-44c7-90de-3086c70416e1 tempest-AttachVolumeNegativeTest-98594709 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-6714f26b-22a9-40d2-a530-2745b25b3024', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '554b0d5c-83cd-4536-b306-9f256fa8c6b9', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:39:25 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-feefc724-273d-4d24-b781-a9f71f6a4997 tempest-AttachVolumeShelveTestJSON-57133601 None] Created volume successfully. Jul 24 09:39:25 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-2dc01992-6312-4708-9875-84c9e38f7b43 req-86616c27-dcb6-44c7-90de-3086c70416e1 tempest-AttachVolumeNegativeTest-98594709 None] attachment_update completed successfully. Jul 24 09:39:25 devstack sudo[92365]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a12824c7-78ed-4727-a888-67e19c0c48e2 tempest-GroupSnapshotsV319Test-2121747091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b01f7590-5a8b-4563-91b9-1730844eeeae" returned: 0 in 0.258s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a12824c7-78ed-4727-a888-67e19c0c48e2 tempest-GroupSnapshotsV319Test-2121747091 None] Lock "cinder-quobyte-b01f7590-5a8b-4563-91b9-1730844eeeae" released by "delete_volume" :: held 0.697s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-a12824c7-78ed-4727-a888-67e19c0c48e2 tempest-GroupSnapshotsV319Test-2121747091 None] Created reservations ['efda76bd-b7e8-43b4-bb8c-0556d48c75e8'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:39:25 devstack cinder-volume[88488]: WARNING cinder.quota [None req-a12824c7-78ed-4727-a888-67e19c0c48e2 tempest-GroupSnapshotsV319Test-2121747091 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1631334812 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1631334812, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:39:25 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-a12824c7-78ed-4727-a888-67e19c0c48e2 tempest-GroupSnapshotsV319Test-2121747091 None] Created reservations ['3337a098-93e2-45a8-8edc-d0bcdfe4cbd5', '2c1a35a4-16b0-4228-9aa7-d310103aa99c', '8340cbef-aa59-4888-929b-286e6e7706c3', 'e9130605-a5fe-4ce0-80bb-4c82a6adb0a9'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:39:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a12824c7-78ed-4727-a888-67e19c0c48e2 tempest-GroupSnapshotsV319Test-2121747091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a12824c7-78ed-4727-a888-67e19c0c48e2 tempest-GroupSnapshotsV319Test-2121747091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a12824c7-78ed-4727-a888-67e19c0c48e2 tempest-GroupSnapshotsV319Test-2121747091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:39:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a12824c7-78ed-4727-a888-67e19c0c48e2 tempest-GroupSnapshotsV319Test-2121747091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:39:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a12824c7-78ed-4727-a888-67e19c0c48e2 tempest-GroupSnapshotsV319Test-2121747091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:39:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a12824c7-78ed-4727-a888-67e19c0c48e2 tempest-GroupSnapshotsV319Test-2121747091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:26 devstack sudo[92436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:39:26 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:26 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a12824c7-78ed-4727-a888-67e19c0c48e2 tempest-GroupSnapshotsV319Test-2121747091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.263s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:26 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-a12824c7-78ed-4727-a888-67e19c0c48e2 tempest-GroupSnapshotsV319Test-2121747091 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:39:26 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-a12824c7-78ed-4727-a888-67e19c0c48e2 tempest-GroupSnapshotsV319Test-2121747091 None] Delete group completed successfully. Jul 24 09:39:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-49eaf5dc-f293-4df6-93d3-bd39780bb00a req-138f63a5-d244-47fe-849b-268755cf1510 tempest-ServerActionsTestOtherA-455552038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-49eaf5dc-f293-4df6-93d3-bd39780bb00a req-138f63a5-d244-47fe-849b-268755cf1510 tempest-ServerActionsTestOtherA-455552038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-49eaf5dc-f293-4df6-93d3-bd39780bb00a req-138f63a5-d244-47fe-849b-268755cf1510 tempest-ServerActionsTestOtherA-455552038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:39:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-49eaf5dc-f293-4df6-93d3-bd39780bb00a req-138f63a5-d244-47fe-849b-268755cf1510 tempest-ServerActionsTestOtherA-455552038 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-f0b8e121-9763-4a29-ab98-9c98969900e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ab2f0d1-019d-4f14-a370-3f55f9c1cb4d', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:39:30 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-49eaf5dc-f293-4df6-93d3-bd39780bb00a req-138f63a5-d244-47fe-849b-268755cf1510 tempest-ServerActionsTestOtherA-455552038 None] attachment_update completed successfully. Jul 24 09:39:35 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=65,cinder:INSERT=16,cinder:UPDATE=70,cinder:DELETE=5 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:39:35 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-b7fe4dbc-6c16-4e78-a8c8-73e19908c9bf req-150ad4b7-6d2a-4edf-b364-586b8bde9378 tempest-ServerActionsTestOtherA-455552038 None] Terminate volume connection completed successfully. Jul 24 09:39:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-b7fe4dbc-6c16-4e78-a8c8-73e19908c9bf req-150ad4b7-6d2a-4edf-b364-586b8bde9378 tempest-ServerActionsTestOtherA-455552038 None] Deleting attachment 2ab2f0d1-019d-4f14-a370-3f55f9c1cb4d. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:39:36 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=68,cinder:UPDATE=67,cinder:DELETE=5,cinder:INSERT=13 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:39:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-b7fe4dbc-6c16-4e78-a8c8-73e19908c9bf req-451f0490-d8a3-405c-931d-69569252c3ab tempest-ServerActionsTestOtherA-455552038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-b7fe4dbc-6c16-4e78-a8c8-73e19908c9bf req-451f0490-d8a3-405c-931d-69569252c3ab tempest-ServerActionsTestOtherA-455552038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-b7fe4dbc-6c16-4e78-a8c8-73e19908c9bf req-451f0490-d8a3-405c-931d-69569252c3ab tempest-ServerActionsTestOtherA-455552038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:39:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-b7fe4dbc-6c16-4e78-a8c8-73e19908c9bf req-451f0490-d8a3-405c-931d-69569252c3ab tempest-ServerActionsTestOtherA-455552038 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-f0b8e121-9763-4a29-ab98-9c98969900e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5581c341-775e-4dd8-afa3-b04b568835c3', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:39:37 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-b7fe4dbc-6c16-4e78-a8c8-73e19908c9bf req-451f0490-d8a3-405c-931d-69569252c3ab tempest-ServerActionsTestOtherA-455552038 None] attachment_update completed successfully. Jul 24 09:39:42 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-119271dd-0867-465a-8d68-3d5a461cd691 req-55185985-1a30-4ae4-82e9-48725ff76fbe tempest-AttachVolumeShelveTestJSON-57133601 None] No connector for attachment 9f725485-56da-489d-ba72-b1d35536089b; skipping storage backend terminate_connection call. {{(pid=88488) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 24 09:39:42 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-119271dd-0867-465a-8d68-3d5a461cd691 req-55185985-1a30-4ae4-82e9-48725ff76fbe tempest-AttachVolumeShelveTestJSON-57133601 None] Deleting attachment 9f725485-56da-489d-ba72-b1d35536089b. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:39:42 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:39:42 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Flow 'volume_create_manager' (76da598c-512c-40c5-aec8-78130835bdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:39:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8b662f-c72f-4aa0-a9e5-cc96d0b9e338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8b662f-c72f-4aa0-a9e5-cc96d0b9e338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1673980115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a554cc8-e473-4cb5-a97d-6c6bb9362be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65baa5248af1435298bf442bcb6e0dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:39:43Z,use_quota=True,user_id='354e6856245c40a0bf97c1167b516714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea7d3e70-fb4f-42c8-b360-2b347eadfb6a),volume_type_id=ea7d3e70-fb4f-42c8-b360-2b347eadfb6a)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8cdaf4d-912f-49b1-972a-f341ca07a3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8cdaf4d-912f-49b1-972a-f341ca07a3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011911ef-40e9-4c00-83e9-9a5822106bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011911ef-40e9-4c00-83e9-9a5822106bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a554cc8-e473-4cb5-a97d-6c6bb9362be6', 'volume_name': 'volume-0a554cc8-e473-4cb5-a97d-6c6bb9362be6', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697ae742-fdac-4575-933f-4f841171bad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697ae742-fdac-4575-933f-4f841171bad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7a13549-cf20-4d72-bbba-bac223f26212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:43 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Volume 0a554cc8-e473-4cb5-a97d-6c6bb9362be6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a554cc8-e473-4cb5-a97d-6c6bb9362be6', 'volume_size': 1} Jul 24 09:39:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1673980115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a554cc8-e473-4cb5-a97d-6c6bb9362be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65baa5248af1435298bf442bcb6e0dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:39:43Z,use_quota=True,user_id='354e6856245c40a0bf97c1167b516714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea7d3e70-fb4f-42c8-b360-2b347eadfb6a),volume_type_id=ea7d3e70-fb4f-42c8-b360-2b347eadfb6a)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:39:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Creating volume 0a554cc8-e473-4cb5-a97d-6c6bb9362be6 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:39:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:39:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:39:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:39:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:39:43 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:39:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0a554cc8-e473-4cb5-a97d-6c6bb9362be6 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:43 devstack sudo[93039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0a554cc8-e473-4cb5-a97d-6c6bb9362be6 1073741824 Jul 24 09:39:43 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:44 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0a554cc8-e473-4cb5-a97d-6c6bb9362be6 1073741824" returned: 0 in 1.122s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0a554cc8-e473-4cb5-a97d-6c6bb9362be6 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:44 devstack sudo[93044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0a554cc8-e473-4cb5-a97d-6c6bb9362be6 Jul 24 09:39:44 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:44 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0a554cc8-e473-4cb5-a97d-6c6bb9362be6" returned: 0 in 0.495s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:39:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:39:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7a13549-cf20-4d72-bbba-bac223f26212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a554cc8-e473-4cb5-a97d-6c6bb9362be6', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbb9f58-898f-44de-80c8-c9dad2083ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:45 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Volume volume-0a554cc8-e473-4cb5-a97d-6c6bb9362be6 (0a554cc8-e473-4cb5-a97d-6c6bb9362be6): created successfully Jul 24 09:39:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbb9f58-898f-44de-80c8-c9dad2083ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Flow 'volume_create_manager' (76da598c-512c-40c5-aec8-78130835bdd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:39:45 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-30745d27-b9e4-4f46-a93b-a485906ba797 tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Created volume successfully. Jul 24 09:39:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-73da1715-03e0-4765-b9c8-b94cd41a28bb tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-73da1715-03e0-4765-b9c8-b94cd41a28bb tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-73da1715-03e0-4765-b9c8-b94cd41a28bb tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:39:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-73da1715-03e0-4765-b9c8-b94cd41a28bb tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:39:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-73da1715-03e0-4765-b9c8-b94cd41a28bb tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:39:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-73da1715-03e0-4765-b9c8-b94cd41a28bb tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:46 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:39:46 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:47 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-73da1715-03e0-4765-b9c8-b94cd41a28bb tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.458s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:47 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-73da1715-03e0-4765-b9c8-b94cd41a28bb tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:39:47 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-73da1715-03e0-4765-b9c8-b94cd41a28bb tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Retype volume completed successfully. Jul 24 09:39:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Acquiring lock "cinder-0a554cc8-e473-4cb5-a97d-6c6bb9362be6-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:39:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Lock "cinder-0a554cc8-e473-4cb5-a97d-6c6bb9362be6-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:39:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Acquiring lock "cinder-quobyte-0a554cc8-e473-4cb5-a97d-6c6bb9362be6" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:39:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Lock "cinder-quobyte-0a554cc8-e473-4cb5-a97d-6c6bb9362be6" acquired by "delete_volume" :: waited 0.049s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:39:48 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4b3f86-2940-4bae-bebe-0e559c9802c0]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:39:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0a554cc8-e473-4cb5-a97d-6c6bb9362be6 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:48 devstack sudo[93082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0a554cc8-e473-4cb5-a97d-6c6bb9362be6 Jul 24 09:39:48 devstack sudo[93082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:49 devstack sudo[93082]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0a554cc8-e473-4cb5-a97d-6c6bb9362be6" returned: 0 in 0.540s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0a554cc8-e473-4cb5-a97d-6c6bb9362be6 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:49 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0a554cc8-e473-4cb5-a97d-6c6bb9362be6 Jul 24 09:39:49 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:49 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0a554cc8-e473-4cb5-a97d-6c6bb9362be6" returned: 0 in 0.482s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Lock "cinder-quobyte-0a554cc8-e473-4cb5-a97d-6c6bb9362be6" released by "delete_volume" :: held 1.118s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:39:49 devstack cinder-volume[88488]: WARNING cinder.quota [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:39:49 devstack cinder-volume[88488]: WARNING cinder.quota [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:39:49 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Created reservations ['7b7223b2-51e0-49ce-8caa-efe9bb9c46c6', '49d089d5-e392-41a9-8cdb-97bea430dbf8', '1413fe71-68f0-4ef4-bc5d-4c9dd48d85df', '1f1c0e96-f5f9-42eb-8c07-7a718a794a57'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:39:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:39:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:39:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:39:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:50 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:39:50 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:50 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.520s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:39:50 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:39:50 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Deleted volume successfully. Jul 24 09:39:50 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1af34495-ccd6-405c-b554-b8cbe3e2646a tempest-VolumeRetypeWithoutMigrationTest-1739759876 None] Lock "cinder-0a554cc8-e473-4cb5-a97d-6c6bb9362be6-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Flow 'volume_create_manager' (40b68532-1d86-416d-8112-7f213eab46bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1260cc-6281-40a6-9290-9eb444444455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1260cc-6281-40a6-9290-9eb444444455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2099694597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3eb88ad-bc0d-445d-9ae0-899d9722239c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4821c6e51249b9b2dd126acf74b608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:39:59Z,use_quota=True,user_id='846720d7c82a4bcc8e2b1a8e9ff4d812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bdab960-ff36-4c29-a7cd-a7b5e7d475ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bdab960-ff36-4c29-a7cd-a7b5e7d475ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725c035e-04a2-4864-b837-cb75f8d01495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725c035e-04a2-4864-b837-cb75f8d01495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3eb88ad-bc0d-445d-9ae0-899d9722239c', 'volume_name': 'volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16cf058e-3a83-46db-ad08-5478129bca5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16cf058e-3a83-46db-ad08-5478129bca5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c5d817-58f4-4ab8-98be-f0773a6efd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:39:59 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Volume b3eb88ad-bc0d-445d-9ae0-899d9722239c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c', 'volume_size': 1} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2099694597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3eb88ad-bc0d-445d-9ae0-899d9722239c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4821c6e51249b9b2dd126acf74b608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:39:59Z,use_quota=True,user_id='846720d7c82a4bcc8e2b1a8e9ff4d812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Creating volume b3eb88ad-bc0d-445d-9ae0-899d9722239c {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:39:59 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:39:59 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c 1073741824 Jul 24 09:39:59 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:39:59 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Jul 24 09:39:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c 1073741824" returned: 0 in 0.487s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:00 devstack sudo[93280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c Jul 24 09:40:00 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:00 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c" returned: 0 in 0.286s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:40:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c5d817-58f4-4ab8-98be-f0773a6efd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2900f23-8e1b-48f6-a5e4-1065ebbca93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:00 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Volume volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c (b3eb88ad-bc0d-445d-9ae0-899d9722239c): created successfully Jul 24 09:40:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2900f23-8e1b-48f6-a5e4-1065ebbca93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Flow 'volume_create_manager' (40b68532-1d86-416d-8112-7f213eab46bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:40:00 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-fb128805-1b3b-495d-a367-e281589b5b05 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Created volume successfully. Jul 24 09:40:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-64c5ac2e-9f88-4da7-b7cd-6b3d4a212821 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-64c5ac2e-9f88-4da7-b7cd-6b3d4a212821 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-64c5ac2e-9f88-4da7-b7cd-6b3d4a212821 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Creating offline snapshot 33038647-5ff2-4ea5-bbbf-6cdc141a6266 of volume b3eb88ad-bc0d-445d-9ae0-899d9722239c {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:40:01 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40621ad-58fb-456a-bed3-5c1088be528a]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:40:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-64c5ac2e-9f88-4da7-b7cd-6b3d4a212821 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:01 devstack sudo[93288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c Jul 24 09:40:01 devstack sudo[93288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:02 devstack sudo[93288]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-64c5ac2e-9f88-4da7-b7cd-6b3d4a212821 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c" returned: 0 in 0.389s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-64c5ac2e-9f88-4da7-b7cd-6b3d4a212821 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.33038647-5ff2-4ea5-bbbf-6cdc141a6266 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:02 devstack sudo[93293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.33038647-5ff2-4ea5-bbbf-6cdc141a6266 1G Jul 24 09:40:02 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:02 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-64c5ac2e-9f88-4da7-b7cd-6b3d4a212821 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.33038647-5ff2-4ea5-bbbf-6cdc141a6266 1G" returned: 0 in 0.371s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-64c5ac2e-9f88-4da7-b7cd-6b3d4a212821 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.33038647-5ff2-4ea5-bbbf-6cdc141a6266 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:02 devstack sudo[93300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.33038647-5ff2-4ea5-bbbf-6cdc141a6266 Jul 24 09:40:02 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:02 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-64c5ac2e-9f88-4da7-b7cd-6b3d4a212821 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.33038647-5ff2-4ea5-bbbf-6cdc141a6266" returned: 0 in 0.282s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:02 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-64c5ac2e-9f88-4da7-b7cd-6b3d4a212821 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.33038647-5ff2-4ea5-bbbf-6cdc141a6266 is being set with open permissions: ugo+rw Jul 24 09:40:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-64c5ac2e-9f88-4da7-b7cd-6b3d4a212821 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.33038647-5ff2-4ea5-bbbf-6cdc141a6266 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:02 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.33038647-5ff2-4ea5-bbbf-6cdc141a6266 Jul 24 09:40:02 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:02 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-64c5ac2e-9f88-4da7-b7cd-6b3d4a212821 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.33038647-5ff2-4ea5-bbbf-6cdc141a6266" returned: 0 in 0.238s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-64c5ac2e-9f88-4da7-b7cd-6b3d4a212821 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:03 devstack sudo[93308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.info Jul 24 09:40:03 devstack sudo[93308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:03 devstack sudo[93308]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-64c5ac2e-9f88-4da7-b7cd-6b3d4a212821 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.info" returned: 0 in 0.244s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:03 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-64c5ac2e-9f88-4da7-b7cd-6b3d4a212821 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.info is being set with open permissions: ugo+rw Jul 24 09:40:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-64c5ac2e-9f88-4da7-b7cd-6b3d4a212821 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:03 devstack sudo[93311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.info Jul 24 09:40:03 devstack sudo[93311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:03 devstack sudo[93311]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-64c5ac2e-9f88-4da7-b7cd-6b3d4a212821 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.info" returned: 0 in 0.242s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-64c5ac2e-9f88-4da7-b7cd-6b3d4a212821 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.863s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:03 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-64c5ac2e-9f88-4da7-b7cd-6b3d4a212821 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Create snapshot completed successfully Jul 24 09:40:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Acquiring lock "cinder-33038647-5ff2-4ea5-bbbf-6cdc141a6266-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:40:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Lock "cinder-33038647-5ff2-4ea5-bbbf-6cdc141a6266-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:40:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Acquiring lock "cinder-quobyte-b3eb88ad-bc0d-445d-9ae0-899d9722239c" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:40:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Lock "cinder-quobyte-b3eb88ad-bc0d-445d-9ae0-899d9722239c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:40:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Acquiring lock "cinder-quobyte-33038647-5ff2-4ea5-bbbf-6cdc141a6266" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:40:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Lock "cinder-quobyte-33038647-5ff2-4ea5-bbbf-6cdc141a6266" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:40:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Deleting offline snapshot 33038647-5ff2-4ea5-bbbf-6cdc141a6266 of volume b3eb88ad-bc0d-445d-9ae0-899d9722239c {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:40:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] snapshot_file for this snap is: volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.33038647-5ff2-4ea5-bbbf-6cdc141a6266 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:40:04 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1039536a-6135-4422-bcbd-a7cba7da46d3]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:40:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.33038647-5ff2-4ea5-bbbf-6cdc141a6266 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:04 devstack sudo[93314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.33038647-5ff2-4ea5-bbbf-6cdc141a6266 Jul 24 09:40:04 devstack sudo[93314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:04 devstack sudo[93314]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.33038647-5ff2-4ea5-bbbf-6cdc141a6266" returned: 0 in 0.388s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:40:04 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f730f09-f32f-44ca-a9b6-15b785a850d9]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:40:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:04 devstack sudo[93319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c Jul 24 09:40:04 devstack sudo[93319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:05 devstack sudo[93319]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c" returned: 0 in 0.383s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.33038647-5ff2-4ea5-bbbf-6cdc141a6266 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:05 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.33038647-5ff2-4ea5-bbbf-6cdc141a6266 Jul 24 09:40:05 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:05 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.33038647-5ff2-4ea5-bbbf-6cdc141a6266" returned: 0 in 0.315s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.33038647-5ff2-4ea5-bbbf-6cdc141a6266 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:05 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.33038647-5ff2-4ea5-bbbf-6cdc141a6266 Jul 24 09:40:05 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:05 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c.33038647-5ff2-4ea5-bbbf-6cdc141a6266" returned: 0 in 0.241s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Lock "cinder-quobyte-33038647-5ff2-4ea5-bbbf-6cdc141a6266" released by "_delete_snapshot" :: held 1.452s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:40:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Lock "cinder-quobyte-b3eb88ad-bc0d-445d-9ae0-899d9722239c" released by "delete_snapshot" :: held 1.481s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:40:05 devstack cinder-volume[88488]: WARNING cinder.quota [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:40:05 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Created reservations ['279a4561-679f-4dc9-873a-76b916be051d', '15e7508e-6d6f-43a6-ac03-ed1b26b1329c', '64b6e735-d204-490c-8440-124b45b1d33c', '1ebaa10c-0e8e-47df-a42b-360e48f50953'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:40:05 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Delete snapshot completed successfully. Jul 24 09:40:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-83035ab7-cc26-4f5a-83a4-18dcd177beb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Lock "cinder-33038647-5ff2-4ea5-bbbf-6cdc141a6266-delete_snapshot" released by "delete_snapshot" :: held 1.696s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:40:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ff6b816a-9995-4fa8-9040-743fad47a84d tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Acquiring lock "cinder-b3eb88ad-bc0d-445d-9ae0-899d9722239c-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:40:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ff6b816a-9995-4fa8-9040-743fad47a84d tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Lock "cinder-b3eb88ad-bc0d-445d-9ae0-899d9722239c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:40:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ff6b816a-9995-4fa8-9040-743fad47a84d tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Acquiring lock "cinder-quobyte-b3eb88ad-bc0d-445d-9ae0-899d9722239c" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:40:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ff6b816a-9995-4fa8-9040-743fad47a84d tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Lock "cinder-quobyte-b3eb88ad-bc0d-445d-9ae0-899d9722239c" acquired by "delete_volume" :: waited 0.023s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:40:06 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb6cc83-4c40-4e98-a090-244e3c107978]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:40:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ff6b816a-9995-4fa8-9040-743fad47a84d tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:06 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c Jul 24 09:40:06 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:07 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ff6b816a-9995-4fa8-9040-743fad47a84d tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c" returned: 0 in 0.428s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ff6b816a-9995-4fa8-9040-743fad47a84d tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:07 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c Jul 24 09:40:07 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:07 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ff6b816a-9995-4fa8-9040-743fad47a84d tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b3eb88ad-bc0d-445d-9ae0-899d9722239c" returned: 0 in 0.282s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ff6b816a-9995-4fa8-9040-743fad47a84d tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Lock "cinder-quobyte-b3eb88ad-bc0d-445d-9ae0-899d9722239c" released by "delete_volume" :: held 0.772s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:40:07 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-ff6b816a-9995-4fa8-9040-743fad47a84d tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Created reservations ['35dfb6da-8af0-4eb1-9f77-bb758ad1dcef', '933c14b7-36a3-444d-8904-2d2876a24750', '11a3870d-a58d-4ef1-852c-4f473be24250', 'fa65cba9-6350-40f8-8992-744cca85c14a'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:40:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ff6b816a-9995-4fa8-9040-743fad47a84d tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ff6b816a-9995-4fa8-9040-743fad47a84d tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ff6b816a-9995-4fa8-9040-743fad47a84d tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:40:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ff6b816a-9995-4fa8-9040-743fad47a84d tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:40:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ff6b816a-9995-4fa8-9040-743fad47a84d tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ff6b816a-9995-4fa8-9040-743fad47a84d tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:07 devstack sudo[93343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:40:07 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:08 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ff6b816a-9995-4fa8-9040-743fad47a84d tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.541s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:08 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-ff6b816a-9995-4fa8-9040-743fad47a84d tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:40:08 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-ff6b816a-9995-4fa8-9040-743fad47a84d tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Deleted volume successfully. Jul 24 09:40:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ff6b816a-9995-4fa8-9040-743fad47a84d tempest-VolumeSnapshotQuotasNegativeTestJSON-450944802 None] Lock "cinder-b3eb88ad-bc0d-445d-9ae0-899d9722239c-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:40:13 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-9602f1c8-6223-47e8-9303-fe317e0f6eff req-6ff1f746-51e5-4364-8fb8-17ceaa5aa1f4 tempest-AttachVolumeNegativeTest-98594709 None] Terminate volume connection completed successfully. Jul 24 09:40:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-9602f1c8-6223-47e8-9303-fe317e0f6eff req-6ff1f746-51e5-4364-8fb8-17ceaa5aa1f4 tempest-AttachVolumeNegativeTest-98594709 None] Deleting attachment 554b0d5c-83cd-4536-b306-9f256fa8c6b9. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:40:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:40:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:40:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:40:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:15 devstack sudo[93422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:40:15 devstack sudo[93422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:15 devstack sudo[93422]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.388s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:40:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:40:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 8 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:40:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Flow 'volume_create_manager' (9defc2d2-8ec3-40a8-98b8-42c4878ab10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade9c79b-1fca-41d0-9296-5466d7c4ab9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade9c79b-1fca-41d0-9296-5466d7c4ab9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1612691196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46120e5f-ea6d-4cf0-86d5-0f6a075e7771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e04e70e4344c29a86c138e01f8bbaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:40:21Z,use_quota=True,user_id='4365b51d16ed4c1a86c078da2e7c8921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152e07bc-ee6f-49df-8827-464d484bea7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152e07bc-ee6f-49df-8827-464d484bea7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a53daa-c06a-456f-a8eb-6bb857570e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a53daa-c06a-456f-a8eb-6bb857570e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46120e5f-ea6d-4cf0-86d5-0f6a075e7771', 'volume_name': 'volume-46120e5f-ea6d-4cf0-86d5-0f6a075e7771', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf76bc7-5f32-4076-9d7d-467499d7ba71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf76bc7-5f32-4076-9d7d-467499d7ba71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd80dcd-0858-4b06-8bb3-c6d01fe30255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:20 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Volume 46120e5f-ea6d-4cf0-86d5-0f6a075e7771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46120e5f-ea6d-4cf0-86d5-0f6a075e7771', 'volume_size': 1} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1612691196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46120e5f-ea6d-4cf0-86d5-0f6a075e7771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e04e70e4344c29a86c138e01f8bbaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:40:21Z,use_quota=True,user_id='4365b51d16ed4c1a86c078da2e7c8921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Creating volume 46120e5f-ea6d-4cf0-86d5-0f6a075e7771 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:40:20 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:40:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-46120e5f-ea6d-4cf0-86d5-0f6a075e7771 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:20 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-46120e5f-ea6d-4cf0-86d5-0f6a075e7771 1073741824 Jul 24 09:40:20 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:21 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-46120e5f-ea6d-4cf0-86d5-0f6a075e7771 1073741824" returned: 0 in 0.528s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-46120e5f-ea6d-4cf0-86d5-0f6a075e7771 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:21 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-46120e5f-ea6d-4cf0-86d5-0f6a075e7771 Jul 24 09:40:21 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:21 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-46120e5f-ea6d-4cf0-86d5-0f6a075e7771" returned: 0 in 0.268s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:21 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:40:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:21 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd80dcd-0858-4b06-8bb3-c6d01fe30255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46120e5f-ea6d-4cf0-86d5-0f6a075e7771', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:21 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff179b1-71ef-4710-a117-acc9035d7f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:21 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Volume volume-46120e5f-ea6d-4cf0-86d5-0f6a075e7771 (46120e5f-ea6d-4cf0-86d5-0f6a075e7771): created successfully Jul 24 09:40:21 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff179b1-71ef-4710-a117-acc9035d7f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:21 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Flow 'volume_create_manager' (9defc2d2-8ec3-40a8-98b8-42c4878ab10f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:40:21 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-8c63398e-e1fe-46e7-8458-ba64e643bb97 tempest-VolumesListAdminTestJSON-1882927985 None] Created volume successfully. Jul 24 09:40:22 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-9eda4d5b-3eac-40d7-8677-e6ccb34d95de req-c6e90735-8c15-456a-bbeb-3b2c11dd6389 tempest-ServerActionsTestOtherA-455552038 None] Terminate volume connection completed successfully. Jul 24 09:40:22 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-9eda4d5b-3eac-40d7-8677-e6ccb34d95de req-c6e90735-8c15-456a-bbeb-3b2c11dd6389 tempest-ServerActionsTestOtherA-455552038 None] Deleting attachment 5581c341-775e-4dd8-afa3-b04b568835c3. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Flow 'volume_create_manager' (71cc397a-45ad-477f-801d-35ab68844bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1830eeb-2619-43fb-8cd2-f6ba91b47d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1830eeb-2619-43fb-8cd2-f6ba91b47d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1588161663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ca9255-71d2-4d47-b411-53502b72ec13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e04e70e4344c29a86c138e01f8bbaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:40:23Z,use_quota=True,user_id='4365b51d16ed4c1a86c078da2e7c8921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb955012-604a-4634-97b0-44058d6e0519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb955012-604a-4634-97b0-44058d6e0519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edfe9c84-5f28-4225-afaa-58fc15e7a2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edfe9c84-5f28-4225-afaa-58fc15e7a2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96ca9255-71d2-4d47-b411-53502b72ec13', 'volume_name': 'volume-96ca9255-71d2-4d47-b411-53502b72ec13', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b19a46a7-f0d5-4d5e-bcc2-a499553c0aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b19a46a7-f0d5-4d5e-bcc2-a499553c0aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87fc1aa5-fc19-45b4-9248-884d6ee69341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:23 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Volume 96ca9255-71d2-4d47-b411-53502b72ec13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96ca9255-71d2-4d47-b411-53502b72ec13', 'volume_size': 1} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1588161663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ca9255-71d2-4d47-b411-53502b72ec13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e04e70e4344c29a86c138e01f8bbaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:40:23Z,use_quota=True,user_id='4365b51d16ed4c1a86c078da2e7c8921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Creating volume 96ca9255-71d2-4d47-b411-53502b72ec13 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:40:23 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:40:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96ca9255-71d2-4d47-b411-53502b72ec13 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:23 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96ca9255-71d2-4d47-b411-53502b72ec13 1073741824 Jul 24 09:40:23 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:24 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96ca9255-71d2-4d47-b411-53502b72ec13 1073741824" returned: 0 in 0.892s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96ca9255-71d2-4d47-b411-53502b72ec13 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:24 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96ca9255-71d2-4d47-b411-53502b72ec13 Jul 24 09:40:24 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:24 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96ca9255-71d2-4d47-b411-53502b72ec13" returned: 0 in 0.499s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:40:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87fc1aa5-fc19-45b4-9248-884d6ee69341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96ca9255-71d2-4d47-b411-53502b72ec13', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c20e57b-58fe-4739-98a5-fa29d1e47059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:25 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Volume volume-96ca9255-71d2-4d47-b411-53502b72ec13 (96ca9255-71d2-4d47-b411-53502b72ec13): created successfully Jul 24 09:40:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c20e57b-58fe-4739-98a5-fa29d1e47059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Flow 'volume_create_manager' (71cc397a-45ad-477f-801d-35ab68844bb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:40:25 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-3324a28e-e73c-49ce-b50f-8cd943b79233 tempest-VolumesListAdminTestJSON-1882927985 None] Created volume successfully. Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Flow 'volume_create_manager' (36b1cdc6-abdd-4605-a102-3cb7f886a553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ccca167-588e-4fb3-9b83-24009af77a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ccca167-588e-4fb3-9b83-24009af77a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-350710024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0577562c-2167-4ee6-9c7f-5034666cb1b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e04e70e4344c29a86c138e01f8bbaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:40:26Z,use_quota=True,user_id='4365b51d16ed4c1a86c078da2e7c8921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c5d8a3-fece-42e2-99a2-bf2374b5aa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c5d8a3-fece-42e2-99a2-bf2374b5aa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feca635c-8694-4dfb-9177-7b0538d4eb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feca635c-8694-4dfb-9177-7b0538d4eb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0577562c-2167-4ee6-9c7f-5034666cb1b6', 'volume_name': 'volume-0577562c-2167-4ee6-9c7f-5034666cb1b6', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c895f2cf-37ca-4d81-8f01-37efb3820653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c895f2cf-37ca-4d81-8f01-37efb3820653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af380b06-9d1c-4349-9267-f8329993c08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:26 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Volume 0577562c-2167-4ee6-9c7f-5034666cb1b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0577562c-2167-4ee6-9c7f-5034666cb1b6', 'volume_size': 1} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-350710024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0577562c-2167-4ee6-9c7f-5034666cb1b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e04e70e4344c29a86c138e01f8bbaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:40:26Z,use_quota=True,user_id='4365b51d16ed4c1a86c078da2e7c8921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Creating volume 0577562c-2167-4ee6-9c7f-5034666cb1b6 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:40:26 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0577562c-2167-4ee6-9c7f-5034666cb1b6 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:26 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0577562c-2167-4ee6-9c7f-5034666cb1b6 1073741824 Jul 24 09:40:26 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:26 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0577562c-2167-4ee6-9c7f-5034666cb1b6 1073741824" returned: 0 in 0.481s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0577562c-2167-4ee6-9c7f-5034666cb1b6 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:26 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0577562c-2167-4ee6-9c7f-5034666cb1b6 Jul 24 09:40:26 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:27 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0577562c-2167-4ee6-9c7f-5034666cb1b6" returned: 0 in 0.338s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:40:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af380b06-9d1c-4349-9267-f8329993c08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0577562c-2167-4ee6-9c7f-5034666cb1b6', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad1002a-06ce-44d8-858d-6ac712552eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:27 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Volume volume-0577562c-2167-4ee6-9c7f-5034666cb1b6 (0577562c-2167-4ee6-9c7f-5034666cb1b6): created successfully Jul 24 09:40:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad1002a-06ce-44d8-858d-6ac712552eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Flow 'volume_create_manager' (36b1cdc6-abdd-4605-a102-3cb7f886a553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:40:27 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-83c088aa-7ee5-4048-9e55-7548c098278e tempest-VolumesListAdminTestJSON-1882927985 None] Created volume successfully. Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Flow 'volume_create_manager' (c2d2cd24-729d-4fa3-95b0-d13935eab1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd0f061-a59c-42e5-8771-e66ed0e388d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd0f061-a59c-42e5-8771-e66ed0e388d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19edd522-517e-40e0-b3cf-47c64ea6211f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14502f571a740c687f59d5a787ec61a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:40:29Z,use_quota=True,user_id='223f5a89afc44b3a8945b6288240a543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcf1da4-71b6-407f-b5fa-d39a0d348681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcf1da4-71b6-407f-b5fa-d39a0d348681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc628b0b-7140-4f8d-a7d3-e6e9172ef83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc628b0b-7140-4f8d-a7d3-e6e9172ef83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19edd522-517e-40e0-b3cf-47c64ea6211f', 'volume_name': 'volume-19edd522-517e-40e0-b3cf-47c64ea6211f', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fe16ea3-575e-4ec2-8e1e-3ef7061bd0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fe16ea3-575e-4ec2-8e1e-3ef7061bd0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc0cf8c-c71d-4929-9970-0450b1b3a5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:29 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Volume 19edd522-517e-40e0-b3cf-47c64ea6211f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19edd522-517e-40e0-b3cf-47c64ea6211f', 'volume_size': 1} Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19edd522-517e-40e0-b3cf-47c64ea6211f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14502f571a740c687f59d5a787ec61a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:40:29Z,use_quota=True,user_id='223f5a89afc44b3a8945b6288240a543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Creating volume 19edd522-517e-40e0-b3cf-47c64ea6211f {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:40:29 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:40:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-19edd522-517e-40e0-b3cf-47c64ea6211f 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:29 devstack sudo[93643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-19edd522-517e-40e0-b3cf-47c64ea6211f 1073741824 Jul 24 09:40:29 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:30 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-19edd522-517e-40e0-b3cf-47c64ea6211f 1073741824" returned: 0 in 0.859s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-19edd522-517e-40e0-b3cf-47c64ea6211f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:30 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-19edd522-517e-40e0-b3cf-47c64ea6211f Jul 24 09:40:30 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:30 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b3195f55-8e7e-48fa-9e1e-16a968cf5333 tempest-ServerActionsTestOtherA-455552038 None] Acquiring lock "cinder-f0b8e121-9763-4a29-ab98-9c98969900e4-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:40:30 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b3195f55-8e7e-48fa-9e1e-16a968cf5333 tempest-ServerActionsTestOtherA-455552038 None] Lock "cinder-f0b8e121-9763-4a29-ab98-9c98969900e4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:40:30 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-19edd522-517e-40e0-b3cf-47c64ea6211f" returned: 0 in 0.435s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:30 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:40:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:30 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b3195f55-8e7e-48fa-9e1e-16a968cf5333 tempest-ServerActionsTestOtherA-455552038 None] Acquiring lock "cinder-quobyte-f0b8e121-9763-4a29-ab98-9c98969900e4" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:40:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc0cf8c-c71d-4929-9970-0450b1b3a5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19edd522-517e-40e0-b3cf-47c64ea6211f', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bae92fc-a548-49d9-833e-0de276da4201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:30 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b3195f55-8e7e-48fa-9e1e-16a968cf5333 tempest-ServerActionsTestOtherA-455552038 None] Lock "cinder-quobyte-f0b8e121-9763-4a29-ab98-9c98969900e4" acquired by "delete_volume" :: waited 0.042s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:40:30 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edadf84-0540-41c9-9c08-88c17a09e1f9]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:40:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b3195f55-8e7e-48fa-9e1e-16a968cf5333 tempest-ServerActionsTestOtherA-455552038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f0b8e121-9763-4a29-ab98-9c98969900e4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:30 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Volume volume-19edd522-517e-40e0-b3cf-47c64ea6211f (19edd522-517e-40e0-b3cf-47c64ea6211f): created successfully Jul 24 09:40:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bae92fc-a548-49d9-833e-0de276da4201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Flow 'volume_create_manager' (c2d2cd24-729d-4fa3-95b0-d13935eab1cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:40:30 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-3e8f16c0-b440-4e52-ab4b-45d338d41846 tempest-VolumesListAdminTestJSON-1460846307 None] Created volume successfully. Jul 24 09:40:30 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f0b8e121-9763-4a29-ab98-9c98969900e4 Jul 24 09:40:30 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:30 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-819adc4b-1561-41fd-baff-2fe03da9c2c5 tempest-AttachVolumeShelveTestJSON-57133601 None] Acquiring lock "cinder-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:40:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-819adc4b-1561-41fd-baff-2fe03da9c2c5 tempest-AttachVolumeShelveTestJSON-57133601 None] Lock "cinder-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:40:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-819adc4b-1561-41fd-baff-2fe03da9c2c5 tempest-AttachVolumeShelveTestJSON-57133601 None] Acquiring lock "cinder-quobyte-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:40:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-819adc4b-1561-41fd-baff-2fe03da9c2c5 tempest-AttachVolumeShelveTestJSON-57133601 None] Lock "cinder-quobyte-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef" acquired by "delete_volume" :: waited 0.026s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:40:31 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a885a1-a49c-4c53-b2d0-af9883e84ffd]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:40:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-819adc4b-1561-41fd-baff-2fe03da9c2c5 tempest-AttachVolumeShelveTestJSON-57133601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:31 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b3195f55-8e7e-48fa-9e1e-16a968cf5333 tempest-ServerActionsTestOtherA-455552038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f0b8e121-9763-4a29-ab98-9c98969900e4" returned: 0 in 0.571s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b3195f55-8e7e-48fa-9e1e-16a968cf5333 tempest-ServerActionsTestOtherA-455552038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f0b8e121-9763-4a29-ab98-9c98969900e4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:31 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f0b8e121-9763-4a29-ab98-9c98969900e4 Jul 24 09:40:31 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:31 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef Jul 24 09:40:31 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-98be904a-b6ba-48c0-9c79-51a3f640a3d9 tempest-VolumesListAdminTestJSON-1460846307 None] Acquiring lock "cinder-19edd522-517e-40e0-b3cf-47c64ea6211f-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:40:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-98be904a-b6ba-48c0-9c79-51a3f640a3d9 tempest-VolumesListAdminTestJSON-1460846307 None] Lock "cinder-19edd522-517e-40e0-b3cf-47c64ea6211f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:40:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-98be904a-b6ba-48c0-9c79-51a3f640a3d9 tempest-VolumesListAdminTestJSON-1460846307 None] Acquiring lock "cinder-quobyte-19edd522-517e-40e0-b3cf-47c64ea6211f" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:40:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-98be904a-b6ba-48c0-9c79-51a3f640a3d9 tempest-VolumesListAdminTestJSON-1460846307 None] Lock "cinder-quobyte-19edd522-517e-40e0-b3cf-47c64ea6211f" acquired by "delete_volume" :: waited 0.029s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:40:31 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[03eea431-5541-4b25-afcf-15c7d5212317]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:40:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-98be904a-b6ba-48c0-9c79-51a3f640a3d9 tempest-VolumesListAdminTestJSON-1460846307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-19edd522-517e-40e0-b3cf-47c64ea6211f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e0be0c6c-70b7-4c23-8441-78347d23965b tempest-VolumesListAdminTestJSON-1882927985 None] Acquiring lock "cinder-0577562c-2167-4ee6-9c7f-5034666cb1b6-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:40:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e0be0c6c-70b7-4c23-8441-78347d23965b tempest-VolumesListAdminTestJSON-1882927985 None] Lock "cinder-0577562c-2167-4ee6-9c7f-5034666cb1b6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:40:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e0be0c6c-70b7-4c23-8441-78347d23965b tempest-VolumesListAdminTestJSON-1882927985 None] Acquiring lock "cinder-quobyte-0577562c-2167-4ee6-9c7f-5034666cb1b6" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:40:31 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b3195f55-8e7e-48fa-9e1e-16a968cf5333 tempest-ServerActionsTestOtherA-455552038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f0b8e121-9763-4a29-ab98-9c98969900e4" returned: 0 in 0.690s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:31 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-19edd522-517e-40e0-b3cf-47c64ea6211f Jul 24 09:40:31 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e0be0c6c-70b7-4c23-8441-78347d23965b tempest-VolumesListAdminTestJSON-1882927985 None] Lock "cinder-quobyte-0577562c-2167-4ee6-9c7f-5034666cb1b6" acquired by "delete_volume" :: waited 0.043s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:40:31 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-819adc4b-1561-41fd-baff-2fe03da9c2c5 tempest-AttachVolumeShelveTestJSON-57133601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef" returned: 0 in 0.847s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-819adc4b-1561-41fd-baff-2fe03da9c2c5 tempest-AttachVolumeShelveTestJSON-57133601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b3195f55-8e7e-48fa-9e1e-16a968cf5333 tempest-ServerActionsTestOtherA-455552038 None] Lock "cinder-quobyte-f0b8e121-9763-4a29-ab98-9c98969900e4" released by "delete_volume" :: held 1.375s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaf1bfe-b62e-4f97-8eeb-9b694944ae7d]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e0be0c6c-70b7-4c23-8441-78347d23965b tempest-VolumesListAdminTestJSON-1882927985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0577562c-2167-4ee6-9c7f-5034666cb1b6 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:32 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef Jul 24 09:40:32 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-b3195f55-8e7e-48fa-9e1e-16a968cf5333 tempest-ServerActionsTestOtherA-455552038 None] Created reservations ['b0e52491-8c2c-4f81-8760-94700d020af7', '6f3c0f53-c040-47a6-9df9-96a4d5cfe137', 'cb8d6c72-741d-46d1-af02-a37eea1f10d5', '7eee3367-5f1c-4cc4-b935-860570912632'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:40:32 devstack sudo[93704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0577562c-2167-4ee6-9c7f-5034666cb1b6 Jul 24 09:40:32 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b3195f55-8e7e-48fa-9e1e-16a968cf5333 tempest-ServerActionsTestOtherA-455552038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b3195f55-8e7e-48fa-9e1e-16a968cf5333 tempest-ServerActionsTestOtherA-455552038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b3195f55-8e7e-48fa-9e1e-16a968cf5333 tempest-ServerActionsTestOtherA-455552038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:40:32 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b3195f55-8e7e-48fa-9e1e-16a968cf5333 tempest-ServerActionsTestOtherA-455552038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b3195f55-8e7e-48fa-9e1e-16a968cf5333 tempest-ServerActionsTestOtherA-455552038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b3195f55-8e7e-48fa-9e1e-16a968cf5333 tempest-ServerActionsTestOtherA-455552038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-98be904a-b6ba-48c0-9c79-51a3f640a3d9 tempest-VolumesListAdminTestJSON-1460846307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-19edd522-517e-40e0-b3cf-47c64ea6211f" returned: 0 in 0.730s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-98be904a-b6ba-48c0-9c79-51a3f640a3d9 tempest-VolumesListAdminTestJSON-1460846307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-19edd522-517e-40e0-b3cf-47c64ea6211f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:32 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:40:32 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:32 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-19edd522-517e-40e0-b3cf-47c64ea6211f Jul 24 09:40:32 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-819adc4b-1561-41fd-baff-2fe03da9c2c5 tempest-AttachVolumeShelveTestJSON-57133601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef" returned: 0 in 0.490s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:32 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-819adc4b-1561-41fd-baff-2fe03da9c2c5 tempest-AttachVolumeShelveTestJSON-57133601 None] Lock "cinder-quobyte-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef" released by "delete_volume" :: held 1.402s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-819adc4b-1561-41fd-baff-2fe03da9c2c5 tempest-AttachVolumeShelveTestJSON-57133601 None] Created reservations ['73cb5e59-742e-423c-b22d-8426b94c6e72', '7c0b47c2-9166-4739-bb71-7b35c0cd4099', '88da3ee9-2058-4690-a4ac-3be54d3f2b99', '25abd8e3-ad42-4e2f-98a5-aaa2a3203d6a'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:40:32 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-98be904a-b6ba-48c0-9c79-51a3f640a3d9 tempest-VolumesListAdminTestJSON-1460846307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-19edd522-517e-40e0-b3cf-47c64ea6211f" returned: 0 in 0.385s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-98be904a-b6ba-48c0-9c79-51a3f640a3d9 tempest-VolumesListAdminTestJSON-1460846307 None] Lock "cinder-quobyte-19edd522-517e-40e0-b3cf-47c64ea6211f" released by "delete_volume" :: held 1.239s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:40:32 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e0be0c6c-70b7-4c23-8441-78347d23965b tempest-VolumesListAdminTestJSON-1882927985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0577562c-2167-4ee6-9c7f-5034666cb1b6" returned: 0 in 0.763s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e0be0c6c-70b7-4c23-8441-78347d23965b tempest-VolumesListAdminTestJSON-1882927985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0577562c-2167-4ee6-9c7f-5034666cb1b6 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:32 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b3195f55-8e7e-48fa-9e1e-16a968cf5333 tempest-ServerActionsTestOtherA-455552038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.512s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:32 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-b3195f55-8e7e-48fa-9e1e-16a968cf5333 tempest-ServerActionsTestOtherA-455552038 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:40:32 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b3195f55-8e7e-48fa-9e1e-16a968cf5333 tempest-ServerActionsTestOtherA-455552038 None] Deleted volume successfully. Jul 24 09:40:32 devstack sudo[93721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0577562c-2167-4ee6-9c7f-5034666cb1b6 Jul 24 09:40:32 devstack sudo[93721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-819adc4b-1561-41fd-baff-2fe03da9c2c5 tempest-AttachVolumeShelveTestJSON-57133601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-819adc4b-1561-41fd-baff-2fe03da9c2c5 tempest-AttachVolumeShelveTestJSON-57133601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-819adc4b-1561-41fd-baff-2fe03da9c2c5 tempest-AttachVolumeShelveTestJSON-57133601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-819adc4b-1561-41fd-baff-2fe03da9c2c5 tempest-AttachVolumeShelveTestJSON-57133601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-819adc4b-1561-41fd-baff-2fe03da9c2c5 tempest-AttachVolumeShelveTestJSON-57133601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-819adc4b-1561-41fd-baff-2fe03da9c2c5 tempest-AttachVolumeShelveTestJSON-57133601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:33 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:40:33 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b3195f55-8e7e-48fa-9e1e-16a968cf5333 tempest-ServerActionsTestOtherA-455552038 None] Lock "cinder-f0b8e121-9763-4a29-ab98-9c98969900e4-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-98be904a-b6ba-48c0-9c79-51a3f640a3d9 tempest-VolumesListAdminTestJSON-1460846307 None] Created reservations ['0e80fe3b-2d54-47a2-9bcc-7eead998497c', '97626b3d-c696-4866-bbdf-d07b97addbd0', '7f36b2cb-2f0d-4af8-8966-c132700d105d', '211fe3dc-aedb-4ac1-b59d-7c73ddf961f9'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-98be904a-b6ba-48c0-9c79-51a3f640a3d9 tempest-VolumesListAdminTestJSON-1460846307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-98be904a-b6ba-48c0-9c79-51a3f640a3d9 tempest-VolumesListAdminTestJSON-1460846307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-98be904a-b6ba-48c0-9c79-51a3f640a3d9 tempest-VolumesListAdminTestJSON-1460846307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-98be904a-b6ba-48c0-9c79-51a3f640a3d9 tempest-VolumesListAdminTestJSON-1460846307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-98be904a-b6ba-48c0-9c79-51a3f640a3d9 tempest-VolumesListAdminTestJSON-1460846307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-98be904a-b6ba-48c0-9c79-51a3f640a3d9 tempest-VolumesListAdminTestJSON-1460846307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:33 devstack sudo[93721]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e0be0c6c-70b7-4c23-8441-78347d23965b tempest-VolumesListAdminTestJSON-1882927985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0577562c-2167-4ee6-9c7f-5034666cb1b6" returned: 0 in 0.635s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:33 devstack sudo[93728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:40:33 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e0be0c6c-70b7-4c23-8441-78347d23965b tempest-VolumesListAdminTestJSON-1882927985 None] Lock "cinder-quobyte-0577562c-2167-4ee6-9c7f-5034666cb1b6" released by "delete_volume" :: held 1.498s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:40:33 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-819adc4b-1561-41fd-baff-2fe03da9c2c5 tempest-AttachVolumeShelveTestJSON-57133601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.512s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-819adc4b-1561-41fd-baff-2fe03da9c2c5 tempest-AttachVolumeShelveTestJSON-57133601 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:40:33 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-819adc4b-1561-41fd-baff-2fe03da9c2c5 tempest-AttachVolumeShelveTestJSON-57133601 None] Deleted volume successfully. Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-819adc4b-1561-41fd-baff-2fe03da9c2c5 tempest-AttachVolumeShelveTestJSON-57133601 None] Lock "cinder-cc354fc9-fe57-4a0f-8a0f-4d1b3a8c1bef-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-e0be0c6c-70b7-4c23-8441-78347d23965b tempest-VolumesListAdminTestJSON-1882927985 None] Created reservations ['4d65e3c2-ee06-4945-9cef-8b933227fe6f', 'c767018a-d1d4-4872-8007-5234a7edecd5', '81535d95-a8a6-4cb3-b654-79747d062359', 'fd2e6fce-f46d-4ce3-a085-5689760320b7'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e0be0c6c-70b7-4c23-8441-78347d23965b tempest-VolumesListAdminTestJSON-1882927985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e0be0c6c-70b7-4c23-8441-78347d23965b tempest-VolumesListAdminTestJSON-1882927985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e0be0c6c-70b7-4c23-8441-78347d23965b tempest-VolumesListAdminTestJSON-1882927985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e0be0c6c-70b7-4c23-8441-78347d23965b tempest-VolumesListAdminTestJSON-1882927985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e0be0c6c-70b7-4c23-8441-78347d23965b tempest-VolumesListAdminTestJSON-1882927985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e0be0c6c-70b7-4c23-8441-78347d23965b tempest-VolumesListAdminTestJSON-1882927985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:33 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:40:33 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:33 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-98be904a-b6ba-48c0-9c79-51a3f640a3d9 tempest-VolumesListAdminTestJSON-1460846307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.571s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-98be904a-b6ba-48c0-9c79-51a3f640a3d9 tempest-VolumesListAdminTestJSON-1460846307 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:40:33 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-98be904a-b6ba-48c0-9c79-51a3f640a3d9 tempest-VolumesListAdminTestJSON-1460846307 None] Deleted volume successfully. Jul 24 09:40:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-98be904a-b6ba-48c0-9c79-51a3f640a3d9 tempest-VolumesListAdminTestJSON-1460846307 None] Lock "cinder-19edd522-517e-40e0-b3cf-47c64ea6211f-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:40:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c0458661-31eb-4bf4-984e-999f68b65d4f tempest-VolumesListAdminTestJSON-1882927985 None] Acquiring lock "cinder-96ca9255-71d2-4d47-b411-53502b72ec13-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:40:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c0458661-31eb-4bf4-984e-999f68b65d4f tempest-VolumesListAdminTestJSON-1882927985 None] Lock "cinder-96ca9255-71d2-4d47-b411-53502b72ec13-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:40:34 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e0be0c6c-70b7-4c23-8441-78347d23965b tempest-VolumesListAdminTestJSON-1882927985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.717s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:34 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-e0be0c6c-70b7-4c23-8441-78347d23965b tempest-VolumesListAdminTestJSON-1882927985 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:40:34 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e0be0c6c-70b7-4c23-8441-78347d23965b tempest-VolumesListAdminTestJSON-1882927985 None] Deleted volume successfully. Jul 24 09:40:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e0be0c6c-70b7-4c23-8441-78347d23965b tempest-VolumesListAdminTestJSON-1882927985 None] Lock "cinder-0577562c-2167-4ee6-9c7f-5034666cb1b6-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:40:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c0458661-31eb-4bf4-984e-999f68b65d4f tempest-VolumesListAdminTestJSON-1882927985 None] Acquiring lock "cinder-quobyte-96ca9255-71d2-4d47-b411-53502b72ec13" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:40:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c0458661-31eb-4bf4-984e-999f68b65d4f tempest-VolumesListAdminTestJSON-1882927985 None] Lock "cinder-quobyte-96ca9255-71d2-4d47-b411-53502b72ec13" acquired by "delete_volume" :: waited 0.067s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:40:34 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba586e98-b570-4143-a564-6265359ff145]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:40:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c0458661-31eb-4bf4-984e-999f68b65d4f tempest-VolumesListAdminTestJSON-1882927985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96ca9255-71d2-4d47-b411-53502b72ec13 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:34 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96ca9255-71d2-4d47-b411-53502b72ec13 Jul 24 09:40:34 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:35 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c0458661-31eb-4bf4-984e-999f68b65d4f tempest-VolumesListAdminTestJSON-1882927985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96ca9255-71d2-4d47-b411-53502b72ec13" returned: 0 in 0.553s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c0458661-31eb-4bf4-984e-999f68b65d4f tempest-VolumesListAdminTestJSON-1882927985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96ca9255-71d2-4d47-b411-53502b72ec13 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:35 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96ca9255-71d2-4d47-b411-53502b72ec13 Jul 24 09:40:35 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:35 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c0458661-31eb-4bf4-984e-999f68b65d4f tempest-VolumesListAdminTestJSON-1882927985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96ca9255-71d2-4d47-b411-53502b72ec13" returned: 0 in 0.352s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:35 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c0458661-31eb-4bf4-984e-999f68b65d4f tempest-VolumesListAdminTestJSON-1882927985 None] Lock "cinder-quobyte-96ca9255-71d2-4d47-b411-53502b72ec13" released by "delete_volume" :: held 0.972s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:40:35 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-c0458661-31eb-4bf4-984e-999f68b65d4f tempest-VolumesListAdminTestJSON-1882927985 None] Created reservations ['d843450d-301b-4d38-a474-3f3a2f60f766', 'd6168fab-5f99-4626-ad8b-5ed243764081', 'a5b9ee63-e5ca-4718-9989-cf34011bf3ee', '37a1c047-220b-45ea-ba0e-27555ab6ce17'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:40:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c0458661-31eb-4bf4-984e-999f68b65d4f tempest-VolumesListAdminTestJSON-1882927985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c0458661-31eb-4bf4-984e-999f68b65d4f tempest-VolumesListAdminTestJSON-1882927985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:35 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c0458661-31eb-4bf4-984e-999f68b65d4f tempest-VolumesListAdminTestJSON-1882927985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:40:35 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c0458661-31eb-4bf4-984e-999f68b65d4f tempest-VolumesListAdminTestJSON-1882927985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:40:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c0458661-31eb-4bf4-984e-999f68b65d4f tempest-VolumesListAdminTestJSON-1882927985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c0458661-31eb-4bf4-984e-999f68b65d4f tempest-VolumesListAdminTestJSON-1882927985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:35 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:40:35 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:36 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c0458661-31eb-4bf4-984e-999f68b65d4f tempest-VolumesListAdminTestJSON-1882927985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.370s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:36 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-c0458661-31eb-4bf4-984e-999f68b65d4f tempest-VolumesListAdminTestJSON-1882927985 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:40:36 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c0458661-31eb-4bf4-984e-999f68b65d4f tempest-VolumesListAdminTestJSON-1882927985 None] Deleted volume successfully. Jul 24 09:40:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c0458661-31eb-4bf4-984e-999f68b65d4f tempest-VolumesListAdminTestJSON-1882927985 None] Lock "cinder-96ca9255-71d2-4d47-b411-53502b72ec13-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:40:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a84bf460-03de-4223-9419-5c763755d5d6 tempest-VolumesListAdminTestJSON-1882927985 None] Acquiring lock "cinder-46120e5f-ea6d-4cf0-86d5-0f6a075e7771-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:40:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a84bf460-03de-4223-9419-5c763755d5d6 tempest-VolumesListAdminTestJSON-1882927985 None] Lock "cinder-46120e5f-ea6d-4cf0-86d5-0f6a075e7771-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:40:36 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=92,cinder:SELECT=68,cinder:INSERT=23,cinder:DELETE=9 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:40:37 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=77,cinder:UPDATE=83,cinder:DELETE=5,cinder:INSERT=16 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:40:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a84bf460-03de-4223-9419-5c763755d5d6 tempest-VolumesListAdminTestJSON-1882927985 None] Acquiring lock "cinder-quobyte-46120e5f-ea6d-4cf0-86d5-0f6a075e7771" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:40:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a84bf460-03de-4223-9419-5c763755d5d6 tempest-VolumesListAdminTestJSON-1882927985 None] Lock "cinder-quobyte-46120e5f-ea6d-4cf0-86d5-0f6a075e7771" acquired by "delete_volume" :: waited 0.031s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:40:37 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d7126e-0395-4746-b596-d4fe3499bded]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:40:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a84bf460-03de-4223-9419-5c763755d5d6 tempest-VolumesListAdminTestJSON-1882927985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-46120e5f-ea6d-4cf0-86d5-0f6a075e7771 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:37 devstack sudo[93784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-46120e5f-ea6d-4cf0-86d5-0f6a075e7771 Jul 24 09:40:37 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:37 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a84bf460-03de-4223-9419-5c763755d5d6 tempest-VolumesListAdminTestJSON-1882927985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-46120e5f-ea6d-4cf0-86d5-0f6a075e7771" returned: 0 in 0.509s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a84bf460-03de-4223-9419-5c763755d5d6 tempest-VolumesListAdminTestJSON-1882927985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-46120e5f-ea6d-4cf0-86d5-0f6a075e7771 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:37 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-46120e5f-ea6d-4cf0-86d5-0f6a075e7771 Jul 24 09:40:37 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:37 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a84bf460-03de-4223-9419-5c763755d5d6 tempest-VolumesListAdminTestJSON-1882927985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-46120e5f-ea6d-4cf0-86d5-0f6a075e7771" returned: 0 in 0.337s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a84bf460-03de-4223-9419-5c763755d5d6 tempest-VolumesListAdminTestJSON-1882927985 None] Lock "cinder-quobyte-46120e5f-ea6d-4cf0-86d5-0f6a075e7771" released by "delete_volume" :: held 0.918s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:40:38 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-a84bf460-03de-4223-9419-5c763755d5d6 tempest-VolumesListAdminTestJSON-1882927985 None] Created reservations ['f9272f48-93ab-4653-893f-53d53a1cd86e', '3dd0d93a-af36-4a51-95bb-feac323e72bb', '47c916b5-c6d3-4748-b8f9-31425bff9d20', 'bd2027b0-f2f2-426c-8598-074d37990bc7'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:40:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a84bf460-03de-4223-9419-5c763755d5d6 tempest-VolumesListAdminTestJSON-1882927985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a84bf460-03de-4223-9419-5c763755d5d6 tempest-VolumesListAdminTestJSON-1882927985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:38 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a84bf460-03de-4223-9419-5c763755d5d6 tempest-VolumesListAdminTestJSON-1882927985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:40:38 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a84bf460-03de-4223-9419-5c763755d5d6 tempest-VolumesListAdminTestJSON-1882927985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:40:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a84bf460-03de-4223-9419-5c763755d5d6 tempest-VolumesListAdminTestJSON-1882927985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a84bf460-03de-4223-9419-5c763755d5d6 tempest-VolumesListAdminTestJSON-1882927985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:38 devstack sudo[93792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:40:38 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:38 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a84bf460-03de-4223-9419-5c763755d5d6 tempest-VolumesListAdminTestJSON-1882927985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.276s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:38 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-a84bf460-03de-4223-9419-5c763755d5d6 tempest-VolumesListAdminTestJSON-1882927985 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:40:38 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-a84bf460-03de-4223-9419-5c763755d5d6 tempest-VolumesListAdminTestJSON-1882927985 None] Deleted volume successfully. Jul 24 09:40:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a84bf460-03de-4223-9419-5c763755d5d6 tempest-VolumesListAdminTestJSON-1882927985 None] Lock "cinder-46120e5f-ea6d-4cf0-86d5-0f6a075e7771-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:40:44 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d1e67efc-270d-4485-bf72-50306a73424d tempest-GroupSnapshotsTest-726205531 None] Group tempest-GroupSnapshotsTest-Group-669828278: creating Jul 24 09:40:44 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d1e67efc-270d-4485-bf72-50306a73424d tempest-GroupSnapshotsTest-726205531 None] Group tempest-GroupSnapshotsTest-Group-669828278: created successfully Jul 24 09:40:44 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d1e67efc-270d-4485-bf72-50306a73424d tempest-GroupSnapshotsTest-726205531 None] Create group completed successfully. Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Flow 'volume_create_manager' (622a81c9-31a8-4bc6-99a9-e9fc077754b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f079fa06-d061-46eb-ab24-0bac142739ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f079fa06-d061-46eb-ab24-0bac142739ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-641109361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4ac1ec86-56f4-4341-ad20-9706a139d021,host='devstack@QuobyteHD#QuobyteHD',id=b11720b7-f19d-4538-ac15-de72e62d3f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2541545cdf43416686209d9c71856312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:40:46Z,use_quota=True,user_id='d9b0fdbea4bc426486e9dd2da77302bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea523c02-8910-4d7f-9d63-3af96cf0a15d),volume_type_id=ea523c02-8910-4d7f-9d63-3af96cf0a15d)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb2ac5c-c5a9-4269-8360-77416c3c908a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb2ac5c-c5a9-4269-8360-77416c3c908a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a85986-7672-4d2e-b1dc-90e4edce257c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a85986-7672-4d2e-b1dc-90e4edce257c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b11720b7-f19d-4538-ac15-de72e62d3f49', 'volume_name': 'volume-b11720b7-f19d-4538-ac15-de72e62d3f49', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750d047c-ac47-4a33-9685-e34ee35baa05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750d047c-ac47-4a33-9685-e34ee35baa05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27dce6fc-c09a-4a9e-bb81-bd1fb76f3197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:46 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Volume b11720b7-f19d-4538-ac15-de72e62d3f49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b11720b7-f19d-4538-ac15-de72e62d3f49', 'volume_size': 1} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4ac1ec86-56f4-4341-ad20-9706a139d021,created_at=2026-07-24T07:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-641109361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4ac1ec86-56f4-4341-ad20-9706a139d021,host='devstack@QuobyteHD#QuobyteHD',id=b11720b7-f19d-4538-ac15-de72e62d3f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2541545cdf43416686209d9c71856312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:40:46Z,use_quota=True,user_id='d9b0fdbea4bc426486e9dd2da77302bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea523c02-8910-4d7f-9d63-3af96cf0a15d),volume_type_id=ea523c02-8910-4d7f-9d63-3af96cf0a15d)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Creating volume b11720b7-f19d-4538-ac15-de72e62d3f49 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:40:46 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:46 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 1073741824 Jul 24 09:40:46 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:46 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 1073741824" returned: 0 in 0.469s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:46 devstack sudo[93834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 Jul 24 09:40:46 devstack sudo[93834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:46 devstack sudo[93834]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49" returned: 0 in 0.270s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27dce6fc-c09a-4a9e-bb81-bd1fb76f3197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b11720b7-f19d-4538-ac15-de72e62d3f49', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c03343a-0267-4ac5-8e5d-399e5cd1fb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:46 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Volume volume-b11720b7-f19d-4538-ac15-de72e62d3f49 (b11720b7-f19d-4538-ac15-de72e62d3f49): created successfully Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c03343a-0267-4ac5-8e5d-399e5cd1fb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Flow 'volume_create_manager' (622a81c9-31a8-4bc6-99a9-e9fc077754b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:40:46 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-4e97cc8c-44fe-4067-8df9-e4da8460b2f8 tempest-GroupSnapshotsTest-726205531 None] Created volume successfully. Jul 24 09:40:47 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] GroupSnapshot fbddb224-ec28-424c-9f8a-db0b30f604d4: creating. Jul 24 09:40:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] Group snapshot fbddb224-ec28-424c-9f8a-db0b30f604d4: creating. {{(pid=88488) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 24 09:40:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] Creating offline snapshot 6fb62db8-c6a3-4813-9c9b-217565011d4b of volume b11720b7-f19d-4538-ac15-de72e62d3f49 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:40:47 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3bf7e6-7450-456f-a4b0-2db54c7a8f9b]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:40:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:47 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 Jul 24 09:40:47 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:48 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49" returned: 0 in 0.440s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:48 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b 1G Jul 24 09:40:48 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:48 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b 1G" returned: 0 in 0.449s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b11720b7-f19d-4538-ac15-de72e62d3f49 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:48 devstack sudo[93848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b11720b7-f19d-4538-ac15-de72e62d3f49 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b Jul 24 09:40:48 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:48 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b11720b7-f19d-4538-ac15-de72e62d3f49 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b" returned: 0 in 0.337s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:48 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b is being set with open permissions: ugo+rw: NotImplementedError Jul 24 09:40:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:48 devstack sudo[93853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b Jul 24 09:40:48 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:49 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b" returned: 0 in 0.260s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:49 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.info Jul 24 09:40:49 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:49 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.info" returned: 0 in 0.273s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:49 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 09:40:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:49 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.info Jul 24 09:40:49 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:49 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.info" returned: 0 in 0.270s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:49 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-4b22d7d5-b47f-40aa-8387-214cf82409db tempest-GroupSnapshotsTest-726205531 None] group_snapshot fbddb224-ec28-424c-9f8a-db0b30f604d4: created successfully Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Flow 'volume_create_manager' (cb9d66ff-10e4-44f7-9343-d7e4a213e7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6c40d3-19bf-477f-8360-e5c0721774d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6c40d3-19bf-477f-8360-e5c0721774d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1086658065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6224039-3f4e-4253-98bd-4d047098cac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab4f1925adc49c0ba0401ec1e290e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:40:51Z,use_quota=True,user_id='159107ae02824637a5299baa77f08d74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (777d108d-cbbe-47d5-bd9d-b0c38d91cd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (777d108d-cbbe-47d5-bd9d-b0c38d91cd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581c5597-16e1-400d-bf72-45ea5125bc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581c5597-16e1-400d-bf72-45ea5125bc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6224039-3f4e-4253-98bd-4d047098cac2', 'volume_name': 'volume-b6224039-3f4e-4253-98bd-4d047098cac2', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07516949-20b2-4a8b-9ef4-97548be30617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07516949-20b2-4a8b-9ef4-97548be30617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973fcb84-4859-4eb6-ac4b-280fe820f484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:50 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Volume b6224039-3f4e-4253-98bd-4d047098cac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6224039-3f4e-4253-98bd-4d047098cac2', 'volume_size': 1} Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1086658065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6224039-3f4e-4253-98bd-4d047098cac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab4f1925adc49c0ba0401ec1e290e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:40:51Z,use_quota=True,user_id='159107ae02824637a5299baa77f08d74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Creating volume b6224039-3f4e-4253-98bd-4d047098cac2 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:40:50 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:40:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:50 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2 1073741824 Jul 24 09:40:50 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:51 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2 1073741824" returned: 0 in 0.510s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:51 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2 Jul 24 09:40:51 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:51 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2" returned: 0 in 0.310s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973fcb84-4859-4eb6-ac4b-280fe820f484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6224039-3f4e-4253-98bd-4d047098cac2', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4ddd80-1616-4eb5-bae9-f35711a29cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:51 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Volume volume-b6224039-3f4e-4253-98bd-4d047098cac2 (b6224039-3f4e-4253-98bd-4d047098cac2): created successfully Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4ddd80-1616-4eb5-bae9-f35711a29cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Flow 'volume_create_manager' (cb9d66ff-10e4-44f7-9343-d7e4a213e7d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "cinder-quobyte-6fb62db8-c6a3-4813-9c9b-217565011d4b-b6a956b4-0271-4403-81ae-89bcde0eaa0d" by "_create_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:40:51 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e93ddcbd-3879-4317-aae8-bc0e0b4b9eca tempest-VolumesDeleteCascade-1016207056 None] Created volume successfully. Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-6fb62db8-c6a3-4813-9c9b-217565011d4b-b6a956b4-0271-4403-81ae-89bcde0eaa0d" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Creating volume b6a956b4-0271-4403-81ae-89bcde0eaa0d from snapshot 6fb62db8-c6a3-4813-9c9b-217565011d4b {{(pid=88488) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "cinder-quobyte-b6a956b4-0271-4403-81ae-89bcde0eaa0d" by "_copy_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-b6a956b4-0271-4403-81ae-89bcde0eaa0d" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] snapshot: 6fb62db8-c6a3-4813-9c9b-217565011d4b, volume: b6a956b4-0271-4403-81ae-89bcde0eaa0d, {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7608b5fa-051e-450b-a24b-d2e0043cd598]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:40:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:52 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b Jul 24 09:40:52 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:52 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b" returned: 0 in 0.581s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b11720b7-f19d-4538-ac15-de72e62d3f49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:40:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 09:40:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Creating direct copy from snapshot {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 09:40:52 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[956157ae-6436-4f8f-9f39-24e934f13f4c]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:40:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:52 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 Jul 24 09:40:52 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:53 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49" returned: 0 in 0.537s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:53 devstack cinder-volume[88488]: DEBUG cinder.utils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Path /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6a956b4-0271-4403-81ae-89bcde0eaa0d not found in is_blk_device check {{(pid=88488) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 09:40:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6a956b4-0271-4403-81ae-89bcde0eaa0d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:53 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6a956b4-0271-4403-81ae-89bcde0eaa0d Jul 24 09:40:53 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5ed598c9-e855-49c9-9d38-d4d393f09d49 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:56 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:40:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Flow 'volume_create_manager' (f4266388-ad60-4520-8e2d-f13c1a4664d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:40:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c28e8f4-41b3-4baf-be73-1b2a8b33c72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c28e8f4-41b3-4baf-be73-1b2a8b33c72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-836494155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=564a3215-ff55-43f0-84d8-5a9adc07e2ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1580e98c9b4578a32eb24ec7885713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:40:56Z,use_quota=True,user_id='ba7b5c7a8deb4bbbbf3677ad360e3bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37129a0e-5c5d-40a6-8c48-528433877828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37129a0e-5c5d-40a6-8c48-528433877828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b98025-5832-4774-ae6d-09e3a4ea6cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b98025-5832-4774-ae6d-09e3a4ea6cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '564a3215-ff55-43f0-84d8-5a9adc07e2ac', 'volume_name': 'volume-564a3215-ff55-43f0-84d8-5a9adc07e2ac', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77036ddd-254c-4168-80fd-bdfa7bb0a381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77036ddd-254c-4168-80fd-bdfa7bb0a381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:40:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894a4c50-f813-4bc6-ba97-d455c718f140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:40:56 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Volume 564a3215-ff55-43f0-84d8-5a9adc07e2ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-564a3215-ff55-43f0-84d8-5a9adc07e2ac', 'volume_size': 1} Jul 24 09:40:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:40:59 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6a956b4-0271-4403-81ae-89bcde0eaa0d" returned: 0 in 5.980s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:59 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[52772e1d-4fec-4c6a-8d2a-a24996ac6825]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:40:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:59 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 Jul 24 09:40:59 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:59 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49" returned: 0 in 0.529s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:59 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49, size 1024.00 MB, duration 5.98 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6a956b4-0271-4403-81ae-89bcde0eaa0d {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:40:59 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Converted 1024.00 MB image at 171.22 MB/s Jul 24 09:40:59 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6a956b4-0271-4403-81ae-89bcde0eaa0d is being set with open permissions: ugo+rw: NotImplementedError Jul 24 09:40:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6a956b4-0271-4403-81ae-89bcde0eaa0d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:40:59 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6a956b4-0271-4403-81ae-89bcde0eaa0d Jul 24 09:40:59 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:40:59 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Jul 24 09:40:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6a956b4-0271-4403-81ae-89bcde0eaa0d" returned: 0 in 0.235s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:40:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-b6a956b4-0271-4403-81ae-89bcde0eaa0d" released by "_copy_volume_from_snapshot" :: held 8.004s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:40:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-6fb62db8-c6a3-4813-9c9b-217565011d4b-b6a956b4-0271-4403-81ae-89bcde0eaa0d" released by "_create_volume_from_snapshot" :: held 8.048s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:40:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.075s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:40:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5ed598c9-e855-49c9-9d38-d4d393f09d49 tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.608s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:40:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-5ed598c9-e855-49c9-9d38-d4d393f09d49 tempest-VolumesDeleteCascade-1016207056 None] Creating offline snapshot b0ede9be-1132-47e0-98cd-ff286798eb04 of volume b6224039-3f4e-4253-98bd-4d047098cac2 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:40:59 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad34f42-680a-4186-a9aa-998f6eb87710]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:40:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5ed598c9-e855-49c9-9d38-d4d393f09d49 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:00 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-8d40c045-164b-4130-9e3c-1c2d62dff19a tempest-GroupSnapshotsTest-726205531 None] Create group from source-snapshot-fbddb224-ec28-424c-9f8a-db0b30f604d4 completed successfully. Jul 24 09:41:00 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2 Jul 24 09:41:00 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:00 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5ed598c9-e855-49c9-9d38-d4d393f09d49 tempest-VolumesDeleteCascade-1016207056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2" returned: 0 in 0.414s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5ed598c9-e855-49c9-9d38-d4d393f09d49 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:00 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 1G Jul 24 09:41:00 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0a5ccaf9-894e-4d5f-bb79-9979b18cef17 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "cinder-quobyte-b6a956b4-0271-4403-81ae-89bcde0eaa0d" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0a5ccaf9-894e-4d5f-bb79-9979b18cef17 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-b6a956b4-0271-4403-81ae-89bcde0eaa0d" acquired by "delete_volume" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:00 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb7f908-cf52-4022-8dfd-162a50530c31]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0a5ccaf9-894e-4d5f-bb79-9979b18cef17 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6a956b4-0271-4403-81ae-89bcde0eaa0d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:00 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5ed598c9-e855-49c9-9d38-d4d393f09d49 tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 1G" returned: 0 in 0.474s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5ed598c9-e855-49c9-9d38-d4d393f09d49 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6224039-3f4e-4253-98bd-4d047098cac2 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:00 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6224039-3f4e-4253-98bd-4d047098cac2 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 Jul 24 09:41:00 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:00 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6a956b4-0271-4403-81ae-89bcde0eaa0d Jul 24 09:41:00 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:01 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5ed598c9-e855-49c9-9d38-d4d393f09d49 tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6224039-3f4e-4253-98bd-4d047098cac2 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04" returned: 0 in 0.297s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:01 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-5ed598c9-e855-49c9-9d38-d4d393f09d49 tempest-VolumesDeleteCascade-1016207056 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 is being set with open permissions: ugo+rw Jul 24 09:41:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5ed598c9-e855-49c9-9d38-d4d393f09d49 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:01 devstack sudo[93944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 Jul 24 09:41:01 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:01 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0a5ccaf9-894e-4d5f-bb79-9979b18cef17 tempest-GroupSnapshotsTest-726205531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6a956b4-0271-4403-81ae-89bcde0eaa0d" returned: 0 in 0.426s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0a5ccaf9-894e-4d5f-bb79-9979b18cef17 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6a956b4-0271-4403-81ae-89bcde0eaa0d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:01 devstack sudo[93946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6a956b4-0271-4403-81ae-89bcde0eaa0d Jul 24 09:41:01 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:01 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5ed598c9-e855-49c9-9d38-d4d393f09d49 tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04" returned: 0 in 0.257s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5ed598c9-e855-49c9-9d38-d4d393f09d49 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:01 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0a5ccaf9-894e-4d5f-bb79-9979b18cef17 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6a956b4-0271-4403-81ae-89bcde0eaa0d" returned: 0 in 0.260s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:01 devstack sudo[93950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.info Jul 24 09:41:01 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0a5ccaf9-894e-4d5f-bb79-9979b18cef17 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-b6a956b4-0271-4403-81ae-89bcde0eaa0d" released by "delete_volume" :: held 0.744s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:01 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-0a5ccaf9-894e-4d5f-bb79-9979b18cef17 tempest-GroupSnapshotsTest-726205531 None] Created reservations ['5ab66aba-0ff7-448f-8d21-a8db5e732cbb'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:01 devstack cinder-volume[88488]: WARNING cinder.quota [None req-0a5ccaf9-894e-4d5f-bb79-9979b18cef17 tempest-GroupSnapshotsTest-726205531 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-301780330 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-301780330, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:41:01 devstack cinder-volume[88488]: WARNING cinder.quota [None req-0a5ccaf9-894e-4d5f-bb79-9979b18cef17 tempest-GroupSnapshotsTest-726205531 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-301780330 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-301780330, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:41:01 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-0a5ccaf9-894e-4d5f-bb79-9979b18cef17 tempest-GroupSnapshotsTest-726205531 None] Created reservations ['d68971fc-0008-4e91-ada4-02330bea74f7', '8c4cce1c-6be6-4c97-8cfc-bac7b3fe481b', 'b5203f1d-277a-4329-99dd-65b72512fcee', '334f3b99-36f3-44bd-ba91-c7616b39b61a'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0a5ccaf9-894e-4d5f-bb79-9979b18cef17 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0a5ccaf9-894e-4d5f-bb79-9979b18cef17 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0a5ccaf9-894e-4d5f-bb79-9979b18cef17 tempest-GroupSnapshotsTest-726205531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0a5ccaf9-894e-4d5f-bb79-9979b18cef17 tempest-GroupSnapshotsTest-726205531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0a5ccaf9-894e-4d5f-bb79-9979b18cef17 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0a5ccaf9-894e-4d5f-bb79-9979b18cef17 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:01 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5ed598c9-e855-49c9-9d38-d4d393f09d49 tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.info" returned: 0 in 0.276s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:01 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-5ed598c9-e855-49c9-9d38-d4d393f09d49 tempest-VolumesDeleteCascade-1016207056 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.info is being set with open permissions: ugo+rw Jul 24 09:41:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5ed598c9-e855-49c9-9d38-d4d393f09d49 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:01 devstack sudo[93953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:41:01 devstack sudo[93953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:01 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.info Jul 24 09:41:01 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:02 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5ed598c9-e855-49c9-9d38-d4d393f09d49 tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.info" returned: 0 in 0.281s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:02 devstack sudo[93953]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5ed598c9-e855-49c9-9d38-d4d393f09d49 tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.171s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.393s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-836494155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=564a3215-ff55-43f0-84d8-5a9adc07e2ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1580e98c9b4578a32eb24ec7885713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:40:56Z,use_quota=True,user_id='ba7b5c7a8deb4bbbbf3677ad360e3bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Creating volume 564a3215-ff55-43f0-84d8-5a9adc07e2ac {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:41:02 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-564a3215-ff55-43f0-84d8-5a9adc07e2ac 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:02 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] group_snapshot fbddb224-ec28-424c-9f8a-db0b30f604d4: deleting Jul 24 09:41:02 devstack sudo[93959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-564a3215-ff55-43f0-84d8-5a9adc07e2ac 1073741824 Jul 24 09:41:02 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0a5ccaf9-894e-4d5f-bb79-9979b18cef17 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.394s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-0a5ccaf9-894e-4d5f-bb79-9979b18cef17 tempest-GroupSnapshotsTest-726205531 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:41:02 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-0a5ccaf9-894e-4d5f-bb79-9979b18cef17 tempest-GroupSnapshotsTest-726205531 None] Delete group completed successfully. Jul 24 09:41:02 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-5ed598c9-e855-49c9-9d38-d4d393f09d49 tempest-VolumesDeleteCascade-1016207056 None] Create snapshot completed successfully Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] group_snapshot fbddb224-ec28-424c-9f8a-db0b30f604d4: deleting {{(pid=88488) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "cinder-quobyte-b11720b7-f19d-4538-ac15-de72e62d3f49" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-b11720b7-f19d-4538-ac15-de72e62d3f49" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "cinder-quobyte-6fb62db8-c6a3-4813-9c9b-217565011d4b" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-6fb62db8-c6a3-4813-9c9b-217565011d4b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] Deleting offline snapshot 6fb62db8-c6a3-4813-9c9b-217565011d4b of volume b11720b7-f19d-4538-ac15-de72e62d3f49 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] snapshot_file for this snap is: volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[af87b341-be1c-41fb-9b90-9c5a7cd6ea8f]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:02 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b Jul 24 09:41:02 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:02 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-564a3215-ff55-43f0-84d8-5a9adc07e2ac 1073741824" returned: 0 in 0.494s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-564a3215-ff55-43f0-84d8-5a9adc07e2ac {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:02 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-564a3215-ff55-43f0-84d8-5a9adc07e2ac Jul 24 09:41:02 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:02 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b" returned: 0 in 0.416s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b11720b7-f19d-4538-ac15-de72e62d3f49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30c3ad4-f2b1-465a-a21b-497ac64e25c5]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:02 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 Jul 24 09:41:02 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:02 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-564a3215-ff55-43f0-84d8-5a9adc07e2ac" returned: 0 in 0.339s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894a4c50-f813-4bc6-ba97-d455c718f140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-564a3215-ff55-43f0-84d8-5a9adc07e2ac', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:02 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e996562-79c6-4197-9ff8-f2751d98c7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:03 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Volume volume-564a3215-ff55-43f0-84d8-5a9adc07e2ac (564a3215-ff55-43f0-84d8-5a9adc07e2ac): created successfully Jul 24 09:41:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e996562-79c6-4197-9ff8-f2751d98c7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Flow 'volume_create_manager' (f4266388-ad60-4520-8e2d-f13c1a4664d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:41:03 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-4dfd4a18-9bb1-4351-bd48-18b97bf18b6c tempest-AttachVolumeNegativeTest-98594709 None] Created volume successfully. Jul 24 09:41:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7ecff853-e01e-44e0-ba1a-2563ea03852d tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7ecff853-e01e-44e0-ba1a-2563ea03852d tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-7ecff853-e01e-44e0-ba1a-2563ea03852d tempest-VolumesDeleteCascade-1016207056 None] Creating offline snapshot 8f560bff-c6fe-41aa-8c31-b8f854b78639 of volume b6224039-3f4e-4253-98bd-4d047098cac2 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:41:03 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3c5d5b-07e4-4b82-8cd1-6f9b21195b1a]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ecff853-e01e-44e0-ba1a-2563ea03852d tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:03 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49" returned: 0 in 0.523s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:03 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b Jul 24 09:41:03 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:03 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 Jul 24 09:41:03 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:03 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ecff853-e01e-44e0-ba1a-2563ea03852d tempest-VolumesDeleteCascade-1016207056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04" returned: 0 in 0.472s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-7ecff853-e01e-44e0-ba1a-2563ea03852d tempest-VolumesDeleteCascade-1016207056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6224039-3f4e-4253-98bd-4d047098cac2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:41:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ecff853-e01e-44e0-ba1a-2563ea03852d tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.8f560bff-c6fe-41aa-8c31-b8f854b78639 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:03 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b" returned: 0 in 0.480s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:03 devstack sudo[93997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.8f560bff-c6fe-41aa-8c31-b8f854b78639 1G Jul 24 09:41:03 devstack sudo[93997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:03 devstack sudo[93999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b Jul 24 09:41:03 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:04 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49.6fb62db8-c6a3-4813-9c9b-217565011d4b" returned: 0 in 0.377s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-6fb62db8-c6a3-4813-9c9b-217565011d4b" released by "_delete_snapshot" :: held 1.919s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-b11720b7-f19d-4538-ac15-de72e62d3f49" released by "delete_snapshot" :: held 1.951s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:04 devstack cinder-volume[88488]: WARNING cinder.quota [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-301780330 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-301780330, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:41:04 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] Created reservations ['c36cb2e8-39c6-404e-9749-c345b661f9fb', '7fb2f08e-e131-47e0-a222-581d9222c9e5', 'dc13988f-803b-4f38-8160-c50fbbcecd19', '070668ef-16d1-41f4-8504-9c78a0963cd0'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:04 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-741c0e55-ebfc-434d-b050-55adc7169ee8 tempest-GroupSnapshotsTest-726205531 None] group_snapshot fbddb224-ec28-424c-9f8a-db0b30f604d4: deleted successfully Jul 24 09:41:04 devstack sudo[93997]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ecff853-e01e-44e0-ba1a-2563ea03852d tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.8f560bff-c6fe-41aa-8c31-b8f854b78639 1G" returned: 0 in 0.726s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ecff853-e01e-44e0-ba1a-2563ea03852d tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.8f560bff-c6fe-41aa-8c31-b8f854b78639 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-dc3647af-5cfb-4669-912e-ba8232fbd1bc req-6cbcd932-3479-4950-9cc7-2043dfa7a51b tempest-AttachVolumeNegativeTest-98594709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:04 devstack sudo[94016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.8f560bff-c6fe-41aa-8c31-b8f854b78639 Jul 24 09:41:04 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d50a49bb-b983-4d71-893d-d548560aec92 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "cinder-quobyte-b11720b7-f19d-4538-ac15-de72e62d3f49" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:04 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ecff853-e01e-44e0-ba1a-2563ea03852d tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.8f560bff-c6fe-41aa-8c31-b8f854b78639" returned: 0 in 0.364s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:04 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-7ecff853-e01e-44e0-ba1a-2563ea03852d tempest-VolumesDeleteCascade-1016207056 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.8f560bff-c6fe-41aa-8c31-b8f854b78639 is being set with open permissions: ugo+rw Jul 24 09:41:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ecff853-e01e-44e0-ba1a-2563ea03852d tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.8f560bff-c6fe-41aa-8c31-b8f854b78639 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:04 devstack sudo[94021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.8f560bff-c6fe-41aa-8c31-b8f854b78639 Jul 24 09:41:04 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d50a49bb-b983-4d71-893d-d548560aec92 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-b11720b7-f19d-4538-ac15-de72e62d3f49" acquired by "delete_volume" :: waited 0.060s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:04 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf4c58b-ea65-4ded-8ca2-bc20725765b0]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d50a49bb-b983-4d71-893d-d548560aec92 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:05 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ecff853-e01e-44e0-ba1a-2563ea03852d tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.8f560bff-c6fe-41aa-8c31-b8f854b78639" returned: 0 in 0.289s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:05 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 Jul 24 09:41:05 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7ecff853-e01e-44e0-ba1a-2563ea03852d tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-dc3647af-5cfb-4669-912e-ba8232fbd1bc req-6cbcd932-3479-4950-9cc7-2043dfa7a51b tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.702s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-dc3647af-5cfb-4669-912e-ba8232fbd1bc req-6cbcd932-3479-4950-9cc7-2043dfa7a51b tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:05 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-7ecff853-e01e-44e0-ba1a-2563ea03852d tempest-VolumesDeleteCascade-1016207056 None] Create snapshot completed successfully Jul 24 09:41:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-dc3647af-5cfb-4669-912e-ba8232fbd1bc req-6cbcd932-3479-4950-9cc7-2043dfa7a51b tempest-AttachVolumeNegativeTest-98594709 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-564a3215-ff55-43f0-84d8-5a9adc07e2ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cdb5cc1f-bddd-455c-94d6-486317f3e2d9', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:41:05 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-dc3647af-5cfb-4669-912e-ba8232fbd1bc req-6cbcd932-3479-4950-9cc7-2043dfa7a51b tempest-AttachVolumeNegativeTest-98594709 None] attachment_update completed successfully. Jul 24 09:41:05 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d50a49bb-b983-4d71-893d-d548560aec92 tempest-GroupSnapshotsTest-726205531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49" returned: 0 in 0.551s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d50a49bb-b983-4d71-893d-d548560aec92 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:05 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49 Jul 24 09:41:05 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:05 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d50a49bb-b983-4d71-893d-d548560aec92 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b11720b7-f19d-4538-ac15-de72e62d3f49" returned: 0 in 0.466s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d50a49bb-b983-4d71-893d-d548560aec92 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-b11720b7-f19d-4538-ac15-de72e62d3f49" released by "delete_volume" :: held 1.115s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-d50a49bb-b983-4d71-893d-d548560aec92 tempest-GroupSnapshotsTest-726205531 None] Created reservations ['1455d2cb-ad5d-41a3-a816-716a5d316b73'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:06 devstack cinder-volume[88488]: WARNING cinder.db.api [None req-d50a49bb-b983-4d71-893d-d548560aec92 tempest-GroupSnapshotsTest-726205531 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-301780330'] Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-d50a49bb-b983-4d71-893d-d548560aec92 tempest-GroupSnapshotsTest-726205531 None] Created reservations ['62b999ce-36b6-445d-846a-087a7b137822', '710c3d5b-73eb-4d6a-bc14-bcf7f1d3e845', 'b0ae5b9f-1bf1-4792-a073-3bb550bdb3b8', '9b9981c0-7802-4720-b849-67bc589bf8ea'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d50a49bb-b983-4d71-893d-d548560aec92 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d50a49bb-b983-4d71-893d-d548560aec92 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d50a49bb-b983-4d71-893d-d548560aec92 tempest-GroupSnapshotsTest-726205531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d50a49bb-b983-4d71-893d-d548560aec92 tempest-GroupSnapshotsTest-726205531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d50a49bb-b983-4d71-893d-d548560aec92 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d50a49bb-b983-4d71-893d-d548560aec92 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:06 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:41:06 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "cinder-b6224039-3f4e-4253-98bd-4d047098cac2-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-b6224039-3f4e-4253-98bd-4d047098cac2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Performing cascade delete. {{(pid=88488) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "cinder-8f560bff-c6fe-41aa-8c31-b8f854b78639-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-8f560bff-c6fe-41aa-8c31-b8f854b78639-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "cinder-quobyte-b6224039-3f4e-4253-98bd-4d047098cac2" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-b6224039-3f4e-4253-98bd-4d047098cac2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "cinder-quobyte-8f560bff-c6fe-41aa-8c31-b8f854b78639" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-8f560bff-c6fe-41aa-8c31-b8f854b78639" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Deleting offline snapshot 8f560bff-c6fe-41aa-8c31-b8f854b78639 of volume b6224039-3f4e-4253-98bd-4d047098cac2 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] snapshot_file for this snap is: volume-b6224039-3f4e-4253-98bd-4d047098cac2.8f560bff-c6fe-41aa-8c31-b8f854b78639 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[596671b7-5850-4ca1-823d-fffcf0a5b5d6]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.8f560bff-c6fe-41aa-8c31-b8f854b78639 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:06 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d50a49bb-b983-4d71-893d-d548560aec92 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.455s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:06 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-d50a49bb-b983-4d71-893d-d548560aec92 tempest-GroupSnapshotsTest-726205531 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:41:06 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d50a49bb-b983-4d71-893d-d548560aec92 tempest-GroupSnapshotsTest-726205531 None] Delete group completed successfully. Jul 24 09:41:06 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.8f560bff-c6fe-41aa-8c31-b8f854b78639 Jul 24 09:41:06 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:07 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.8f560bff-c6fe-41aa-8c31-b8f854b78639" returned: 0 in 0.396s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6224039-3f4e-4253-98bd-4d047098cac2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:41:07 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[329ecbe7-1abc-4954-aae2-382263aab0eb]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:07 devstack sudo[94445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 Jul 24 09:41:07 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:07 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04" returned: 0 in 0.506s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6224039-3f4e-4253-98bd-4d047098cac2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:41:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.8f560bff-c6fe-41aa-8c31-b8f854b78639 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:07 devstack sudo[94451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.8f560bff-c6fe-41aa-8c31-b8f854b78639 Jul 24 09:41:07 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:07 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b1355e17-1d52-4bba-b5c2-97a0c0e8cb05 tempest-GroupSnapshotsTest-726205531 None] Group tempest-GroupSnapshotsTest-Group-1113182983: creating Jul 24 09:41:07 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b1355e17-1d52-4bba-b5c2-97a0c0e8cb05 tempest-GroupSnapshotsTest-726205531 None] Group tempest-GroupSnapshotsTest-Group-1113182983: created successfully Jul 24 09:41:07 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b1355e17-1d52-4bba-b5c2-97a0c0e8cb05 tempest-GroupSnapshotsTest-726205531 None] Create group completed successfully. Jul 24 09:41:08 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.8f560bff-c6fe-41aa-8c31-b8f854b78639" returned: 0 in 0.797s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.8f560bff-c6fe-41aa-8c31-b8f854b78639 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:08 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.8f560bff-c6fe-41aa-8c31-b8f854b78639 Jul 24 09:41:08 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:08 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-a1f32b00-7ca8-429c-93a0-01afb8e85367 req-933139cb-0a1c-445a-bbd0-985342ee47e4 tempest-AttachVolumeNegativeTest-98594709 None] Terminate volume connection completed successfully. Jul 24 09:41:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-a1f32b00-7ca8-429c-93a0-01afb8e85367 req-933139cb-0a1c-445a-bbd0-985342ee47e4 tempest-AttachVolumeNegativeTest-98594709 None] Deleting attachment cdb5cc1f-bddd-455c-94d6-486317f3e2d9. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:41:08 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.8f560bff-c6fe-41aa-8c31-b8f854b78639" returned: 0 in 0.453s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-8f560bff-c6fe-41aa-8c31-b8f854b78639" released by "_delete_snapshot" :: held 2.285s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-b6224039-3f4e-4253-98bd-4d047098cac2" released by "delete_snapshot" :: held 2.308s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:09 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Created reservations ['9b806865-6ce6-4a7e-96e6-7d9f547d5f16', '681d1d2a-8aba-47be-b3d1-8f1ff23eda3a', 'c986a8d5-be4b-4076-93e3-390cd768d8d2', 'f3ef1cf6-2513-4979-82d4-0a37dbe4f252'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:09 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Delete snapshot completed successfully. Jul 24 09:41:09 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-8f560bff-c6fe-41aa-8c31-b8f854b78639-delete_snapshot" released by "delete_snapshot" :: held 2.674s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:09 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "cinder-b0ede9be-1132-47e0-98cd-ff286798eb04-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:09 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-b0ede9be-1132-47e0-98cd-ff286798eb04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:09 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "cinder-quobyte-b6224039-3f4e-4253-98bd-4d047098cac2" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:09 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-b6224039-3f4e-4253-98bd-4d047098cac2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:09 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "cinder-quobyte-b0ede9be-1132-47e0-98cd-ff286798eb04" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:09 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-b0ede9be-1132-47e0-98cd-ff286798eb04" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Deleting offline snapshot b0ede9be-1132-47e0-98cd-ff286798eb04 of volume b6224039-3f4e-4253-98bd-4d047098cac2 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:41:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] snapshot_file for this snap is: volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:41:09 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[271939ee-8886-4d63-8383-ca600fb09328]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:09 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 Jul 24 09:41:09 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:10 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04" returned: 0 in 0.749s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6224039-3f4e-4253-98bd-4d047098cac2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Flow 'volume_create_manager' (980cd08a-d0a3-496c-81c7-674fb5158080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b520980f-3937-408a-8d2f-6a19b957a281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8af61ce-65a5-491c-97fd-a8214bf5d08a]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b520980f-3937-408a-8d2f-6a19b957a281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-963001854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e68387d3-3230-4a7c-abed-98b6890db03f,host='devstack@QuobyteHD#QuobyteHD',id=2933d7b8-ff75-40ec-ac75-c06fbb23fa44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2541545cdf43416686209d9c71856312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:41:10Z,use_quota=True,user_id='d9b0fdbea4bc426486e9dd2da77302bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(347b9b0f-add9-4420-b52c-e00c7647815c),volume_type_id=347b9b0f-add9-4420-b52c-e00c7647815c)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216fd50f-0311-4a26-97fe-7ea0232a88b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216fd50f-0311-4a26-97fe-7ea0232a88b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (665699b1-82f6-429e-a721-ff61bfe59d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (665699b1-82f6-429e-a721-ff61bfe59d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2933d7b8-ff75-40ec-ac75-c06fbb23fa44', 'volume_name': 'volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d028f3-8a16-44f6-a192-da249a499c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d028f3-8a16-44f6-a192-da249a499c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (243861c1-d77b-49fe-b2bf-940bd0e4bfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:10 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Volume 2933d7b8-ff75-40ec-ac75-c06fbb23fa44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44', 'volume_size': 1} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e68387d3-3230-4a7c-abed-98b6890db03f,created_at=2026-07-24T07:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-963001854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e68387d3-3230-4a7c-abed-98b6890db03f,host='devstack@QuobyteHD#QuobyteHD',id=2933d7b8-ff75-40ec-ac75-c06fbb23fa44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2541545cdf43416686209d9c71856312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:41:10Z,use_quota=True,user_id='d9b0fdbea4bc426486e9dd2da77302bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(347b9b0f-add9-4420-b52c-e00c7647815c),volume_type_id=347b9b0f-add9-4420-b52c-e00c7647815c)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Creating volume 2933d7b8-ff75-40ec-ac75-c06fbb23fa44 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:41:10 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:10 devstack sudo[94578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44 1073741824 Jul 24 09:41:10 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:10 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2 Jul 24 09:41:10 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:10 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2" returned: 0 in 0.708s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:10 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 Jul 24 09:41:10 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:10 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44 1073741824" returned: 0 in 0.718s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:11 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44 Jul 24 09:41:11 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:11 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44" returned: 0 in 0.488s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:41:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:11 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (243861c1-d77b-49fe-b2bf-940bd0e4bfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e76ec7-53a8-4dda-b98c-539d7a9b08d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04" returned: 0 in 0.714s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:11 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Volume volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44 (2933d7b8-ff75-40ec-ac75-c06fbb23fa44): created successfully Jul 24 09:41:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e76ec7-53a8-4dda-b98c-539d7a9b08d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Flow 'volume_create_manager' (980cd08a-d0a3-496c-81c7-674fb5158080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:41:11 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04 Jul 24 09:41:11 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:11 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-04e79aa6-debe-4954-91f5-b776ba6b9075 tempest-GroupSnapshotsTest-726205531 None] Created volume successfully. Jul 24 09:41:12 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2.b0ede9be-1132-47e0-98cd-ff286798eb04" returned: 0 in 0.432s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-b0ede9be-1132-47e0-98cd-ff286798eb04" released by "_delete_snapshot" :: held 2.768s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-b6224039-3f4e-4253-98bd-4d047098cac2" released by "delete_snapshot" :: held 2.794s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:12 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Created reservations ['d1b45bc1-5baa-42ea-a946-4304d22a2dff', '2251d2f4-e4bf-4497-999b-d5b06c3e4998', 'f52adbc7-a90d-4db6-b0bc-1eff0034bf24', 'de65a070-4374-4f8a-8885-f8f4d480aae3'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:12 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Delete snapshot completed successfully. Jul 24 09:41:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-b0ede9be-1132-47e0-98cd-ff286798eb04-delete_snapshot" released by "delete_snapshot" :: held 2.977s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Snapshots deleted, issuing volume delete {{(pid=88488) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 24 09:41:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "cinder-quobyte-b6224039-3f4e-4253-98bd-4d047098cac2" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-b6224039-3f4e-4253-98bd-4d047098cac2" acquired by "delete_volume" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:12 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b369cf50-3d17-4023-8d17-02ded10fa1e2]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:12 devstack sudo[94625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2 Jul 24 09:41:12 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:12 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2" returned: 0 in 0.549s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:12 devstack sudo[94632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2 Jul 24 09:41:12 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:13 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6224039-3f4e-4253-98bd-4d047098cac2" returned: 0 in 0.650s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-b6224039-3f4e-4253-98bd-4d047098cac2" released by "delete_volume" :: held 1.282s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:13 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Created reservations ['0785103d-4bad-4129-8c71-5c28ee82b73e', 'a01fe16a-2935-4a58-9f3d-8da774e04ea7', '3da2c60c-e3df-4c1f-a551-787c2e3f49fd', '38774baf-ff96-41b0-be02-5a5541900603'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:13 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:41:13 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:13 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Flow 'volume_create_manager' (cbe92d60-8af8-4945-afd2-5e62a5bbbc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a6a9c3-8922-4abf-aad0-d0c06c5fa74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a6a9c3-8922-4abf-aad0-d0c06c5fa74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-197910624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e68387d3-3230-4a7c-abed-98b6890db03f,host='devstack@QuobyteHD#QuobyteHD',id=bf861f30-5c2d-4f98-b43c-544db9064f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2541545cdf43416686209d9c71856312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:41:14Z,use_quota=True,user_id='d9b0fdbea4bc426486e9dd2da77302bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(347b9b0f-add9-4420-b52c-e00c7647815c),volume_type_id=347b9b0f-add9-4420-b52c-e00c7647815c)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367d263f-1298-4b7b-a907-c06758a6c4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367d263f-1298-4b7b-a907-c06758a6c4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f7fe9f1-cb32-421e-82cb-f0d7a0f58b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f7fe9f1-cb32-421e-82cb-f0d7a0f58b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf861f30-5c2d-4f98-b43c-544db9064f50', 'volume_name': 'volume-bf861f30-5c2d-4f98-b43c-544db9064f50', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08fc6352-7f3f-42c1-8692-26cef3bd2fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08fc6352-7f3f-42c1-8692-26cef3bd2fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41bd85b1-9c87-4241-b377-740446d4b47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:14 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Volume bf861f30-5c2d-4f98-b43c-544db9064f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf861f30-5c2d-4f98-b43c-544db9064f50', 'volume_size': 1} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e68387d3-3230-4a7c-abed-98b6890db03f,created_at=2026-07-24T07:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-197910624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e68387d3-3230-4a7c-abed-98b6890db03f,host='devstack@QuobyteHD#QuobyteHD',id=bf861f30-5c2d-4f98-b43c-544db9064f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2541545cdf43416686209d9c71856312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:41:14Z,use_quota=True,user_id='d9b0fdbea4bc426486e9dd2da77302bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(347b9b0f-add9-4420-b52c-e00c7647815c),volume_type_id=347b9b0f-add9-4420-b52c-e00c7647815c)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Creating volume bf861f30-5c2d-4f98-b43c-544db9064f50 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:41:14 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:41:14 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.435s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:41:14 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Deleted volume successfully. Jul 24 09:41:14 devstack sudo[94639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50 1073741824 Jul 24 09:41:14 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b542b758-e02d-4d7f-bdb1-ecaefc50eff5 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-b6224039-3f4e-4253-98bd-4d047098cac2-delete_volume" released by "delete_volume" :: held 7.819s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:14 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50 1073741824" returned: 0 in 0.787s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:15 devstack sudo[94644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:41:15 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:15 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50 Jul 24 09:41:15 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:41:15 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Flow 'volume_create_manager' (37abe36c-c467-4dcd-8115-b4a627d0ab12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1de893-0354-4b6a-b2bd-5dfb917f0ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.509s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1de893-0354-4b6a-b2bd-5dfb917f0ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-964930743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e83d56-9455-4e59-b9fb-d64f25ae1f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab4f1925adc49c0ba0401ec1e290e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:41:15Z,use_quota=True,user_id='159107ae02824637a5299baa77f08d74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d99e08e-4bf2-4b80-b811-a9d30281dd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d99e08e-4bf2-4b80-b811-a9d30281dd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec80281-0a55-4aa6-af61-29b94b02337d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec80281-0a55-4aa6-af61-29b94b02337d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58e83d56-9455-4e59-b9fb-d64f25ae1f50', 'volume_name': 'volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a789a5-368b-4dff-a34a-d309782667ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a789a5-368b-4dff-a34a-d309782667ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de41472b-5af1-4cf4-8cf1-0bb856412a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:15 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Volume 58e83d56-9455-4e59-b9fb-d64f25ae1f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50', 'volume_size': 1} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 8 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:41:15 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50" returned: 0 in 0.591s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.165s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-964930743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e83d56-9455-4e59-b9fb-d64f25ae1f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab4f1925adc49c0ba0401ec1e290e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:41:15Z,use_quota=True,user_id='159107ae02824637a5299baa77f08d74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Creating volume 58e83d56-9455-4e59-b9fb-d64f25ae1f50 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:41:15 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41bd85b1-9c87-4241-b377-740446d4b47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf861f30-5c2d-4f98-b43c-544db9064f50', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c29d24-6d2c-4cc8-81cf-c8601b3078a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:15 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Volume volume-bf861f30-5c2d-4f98-b43c-544db9064f50 (bf861f30-5c2d-4f98-b43c-544db9064f50): created successfully Jul 24 09:41:15 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 1073741824 Jul 24 09:41:15 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c29d24-6d2c-4cc8-81cf-c8601b3078a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Flow 'volume_create_manager' (cbe92d60-8af8-4945-afd2-5e62a5bbbc94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:41:15 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-64c4f81a-8154-409c-9bda-3614fe863fb3 tempest-GroupSnapshotsTest-726205531 None] Created volume successfully. Jul 24 09:41:16 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 1073741824" returned: 0 in 0.772s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:16 devstack sudo[94668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 Jul 24 09:41:16 devstack sudo[94668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:17 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d59f13e6-b278-4a8f-b253-9c120885dac2 tempest-GroupSnapshotsTest-726205531 None] Update group completed successfully. Jul 24 09:41:17 devstack sudo[94668]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50" returned: 0 in 0.589s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:17 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:41:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de41472b-5af1-4cf4-8cf1-0bb856412a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1224de5c-7afb-4bdf-9a90-b0f2a3050c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:17 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Volume volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 (58e83d56-9455-4e59-b9fb-d64f25ae1f50): created successfully Jul 24 09:41:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1224de5c-7afb-4bdf-9a90-b0f2a3050c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Flow 'volume_create_manager' (37abe36c-c467-4dcd-8115-b4a627d0ab12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:41:17 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-644089e1-e4f5-4ee5-8abf-19acec743b36 tempest-VolumesDeleteCascade-1016207056 None] Created volume successfully. Jul 24 09:41:18 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-8441e58f-18b7-4848-b63e-ffba0e3c6dda tempest-GroupSnapshotsTest-726205531 None] Update group completed successfully. Jul 24 09:41:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4a522fd5-8c0f-4d8b-bfcf-bec277100fbe tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4a522fd5-8c0f-4d8b-bfcf-bec277100fbe tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4a522fd5-8c0f-4d8b-bfcf-bec277100fbe tempest-VolumesDeleteCascade-1016207056 None] Creating offline snapshot fd92449f-57bc-411c-a531-15687c136dce of volume 58e83d56-9455-4e59-b9fb-d64f25ae1f50 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:41:18 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfb91bc-08fa-4224-8337-4631a085ac54]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4a522fd5-8c0f-4d8b-bfcf-bec277100fbe tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:18 devstack sudo[94707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 Jul 24 09:41:18 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:18 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4a522fd5-8c0f-4d8b-bfcf-bec277100fbe tempest-VolumesDeleteCascade-1016207056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50" returned: 0 in 0.396s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4a522fd5-8c0f-4d8b-bfcf-bec277100fbe tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:19 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce 1G Jul 24 09:41:19 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:19 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-87713695-dbf3-4bf2-b2fa-eacc85bdc2ff tempest-GroupSnapshotsTest-726205531 None] Update group completed successfully. Jul 24 09:41:19 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4a522fd5-8c0f-4d8b-bfcf-bec277100fbe tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce 1G" returned: 0 in 0.516s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4a522fd5-8c0f-4d8b-bfcf-bec277100fbe tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:19 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce Jul 24 09:41:19 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:19 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4a522fd5-8c0f-4d8b-bfcf-bec277100fbe tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce" returned: 0 in 0.314s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:19 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-4a522fd5-8c0f-4d8b-bfcf-bec277100fbe tempest-VolumesDeleteCascade-1016207056 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce is being set with open permissions: ugo+rw Jul 24 09:41:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4a522fd5-8c0f-4d8b-bfcf-bec277100fbe tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:19 devstack sudo[94722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce Jul 24 09:41:19 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:20 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4a522fd5-8c0f-4d8b-bfcf-bec277100fbe tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce" returned: 0 in 0.268s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4a522fd5-8c0f-4d8b-bfcf-bec277100fbe tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:20 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.info Jul 24 09:41:20 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:20 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4a522fd5-8c0f-4d8b-bfcf-bec277100fbe tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.info" returned: 0 in 0.311s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:20 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-4a522fd5-8c0f-4d8b-bfcf-bec277100fbe tempest-VolumesDeleteCascade-1016207056 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.info is being set with open permissions: ugo+rw Jul 24 09:41:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4a522fd5-8c0f-4d8b-bfcf-bec277100fbe tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:20 devstack sudo[94731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.info Jul 24 09:41:20 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:20 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-8e0c6363-b664-49d1-89fd-23e546443430 tempest-GroupSnapshotsTest-726205531 None] Update group completed successfully. Jul 24 09:41:20 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4a522fd5-8c0f-4d8b-bfcf-bec277100fbe tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.info" returned: 0 in 0.348s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4a522fd5-8c0f-4d8b-bfcf-bec277100fbe tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:20 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-4a522fd5-8c0f-4d8b-bfcf-bec277100fbe tempest-VolumesDeleteCascade-1016207056 None] Create snapshot completed successfully Jul 24 09:41:22 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] GroupSnapshot 0fb143e2-5781-430b-b4de-2260ab20eef0: creating. Jul 24 09:41:22 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Group snapshot 0fb143e2-5781-430b-b4de-2260ab20eef0: creating. {{(pid=88488) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 24 09:41:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:22 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Creating offline snapshot 03c82747-32ab-44bf-a980-9563796fe094 of volume 2933d7b8-ff75-40ec-ac75-c06fbb23fa44 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:41:22 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[626a97d6-fbc2-4b09-b6d7-0e8c98f25689]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:23 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:41:23 devstack sudo[94751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44 Jul 24 09:41:23 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Flow 'volume_create_manager' (15b76324-2750-424f-9ab3-4df5f17d5fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:41:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc5f802c-43a1-4e7c-9fca-0f47fd441fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc5f802c-43a1-4e7c-9fca-0f47fd441fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1956191052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d632737f-8c69-4b4b-afef-41573cef4568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab4f1925adc49c0ba0401ec1e290e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fd92449f-57bc-411c-a531-15687c136dce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:41:23Z,use_quota=True,user_id='159107ae02824637a5299baa77f08d74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ff6fc42-bcd0-4cac-bbd7-e960fd26ae0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ff6fc42-bcd0-4cac-bbd7-e960fd26ae0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eaa741d-f468-45df-93fd-63d629f9fe2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eaa741d-f468-45df-93fd-63d629f9fe2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd632737f-8c69-4b4b-afef-41573cef4568', 'volume_name': 'volume-d632737f-8c69-4b4b-afef-41573cef4568', 'volume_size': 1, 'snapshot_id': 'fd92449f-57bc-411c-a531-15687c136dce'}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c83203-11b2-4ce5-b55b-277976e2b14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c83203-11b2-4ce5-b55b-277976e2b14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719799ba-41c9-413b-bc72-8f6a1156fe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:23 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Volume d632737f-8c69-4b4b-afef-41573cef4568: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d632737f-8c69-4b4b-afef-41573cef4568', 'volume_size': 1, 'snapshot_id': 'fd92449f-57bc-411c-a531-15687c136dce'} Jul 24 09:41:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:23 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44" returned: 0 in 0.520s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.03c82747-32ab-44bf-a980-9563796fe094 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:23 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.03c82747-32ab-44bf-a980-9563796fe094 1G Jul 24 09:41:23 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:23 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.03c82747-32ab-44bf-a980-9563796fe094 1G" returned: 0 in 0.516s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.03c82747-32ab-44bf-a980-9563796fe094 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:23 devstack sudo[94762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.03c82747-32ab-44bf-a980-9563796fe094 Jul 24 09:41:23 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:24 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.03c82747-32ab-44bf-a980-9563796fe094" returned: 0 in 0.358s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:24 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.03c82747-32ab-44bf-a980-9563796fe094 is being set with open permissions: ugo+rw: NotImplementedError Jul 24 09:41:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.03c82747-32ab-44bf-a980-9563796fe094 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:24 devstack sudo[94781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.03c82747-32ab-44bf-a980-9563796fe094 Jul 24 09:41:24 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:24 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.03c82747-32ab-44bf-a980-9563796fe094" returned: 0 in 0.318s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:24 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.info Jul 24 09:41:24 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:24 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.info" returned: 0 in 0.294s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:24 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 09:41:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:24 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.info Jul 24 09:41:24 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:25 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.info" returned: 0 in 0.433s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.584s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Creating offline snapshot 56320f39-4aea-4c0c-b477-ee00a2bf29b5 of volume bf861f30-5c2d-4f98-b43c-544db9064f50 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:41:25 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd6560c-f749-4e0d-8444-c230bb5dd306]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:25 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50 Jul 24 09:41:25 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:26 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50" returned: 0 in 0.570s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.56320f39-4aea-4c0c-b477-ee00a2bf29b5 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:26 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.56320f39-4aea-4c0c-b477-ee00a2bf29b5 1G Jul 24 09:41:26 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:26 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.56320f39-4aea-4c0c-b477-ee00a2bf29b5 1G" returned: 0 in 0.453s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf861f30-5c2d-4f98-b43c-544db9064f50 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.56320f39-4aea-4c0c-b477-ee00a2bf29b5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:26 devstack sudo[94873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf861f30-5c2d-4f98-b43c-544db9064f50 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.56320f39-4aea-4c0c-b477-ee00a2bf29b5 Jul 24 09:41:26 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:26 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf861f30-5c2d-4f98-b43c-544db9064f50 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.56320f39-4aea-4c0c-b477-ee00a2bf29b5" returned: 0 in 0.300s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:26 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.56320f39-4aea-4c0c-b477-ee00a2bf29b5 is being set with open permissions: ugo+rw: NotImplementedError Jul 24 09:41:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.56320f39-4aea-4c0c-b477-ee00a2bf29b5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:26 devstack sudo[94888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.56320f39-4aea-4c0c-b477-ee00a2bf29b5 Jul 24 09:41:26 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:27 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.56320f39-4aea-4c0c-b477-ee00a2bf29b5" returned: 0 in 0.241s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:27 devstack sudo[94891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.info Jul 24 09:41:27 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:27 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.info" returned: 0 in 0.282s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:27 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:27 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.info Jul 24 09:41:27 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:27 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.info" returned: 0 in 0.285s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.238s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.315s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "cinder-quobyte-fd92449f-57bc-411c-a531-15687c136dce-d632737f-8c69-4b4b-afef-41573cef4568" by "_create_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-fd92449f-57bc-411c-a531-15687c136dce-d632737f-8c69-4b4b-afef-41573cef4568" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Creating volume d632737f-8c69-4b4b-afef-41573cef4568 from snapshot fd92449f-57bc-411c-a531-15687c136dce {{(pid=88488) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "cinder-quobyte-d632737f-8c69-4b4b-afef-41573cef4568" by "_copy_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-d632737f-8c69-4b4b-afef-41573cef4568" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] snapshot: fd92449f-57bc-411c-a531-15687c136dce, volume: d632737f-8c69-4b4b-afef-41573cef4568, {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eb3066-a477-45d2-b0ae-01776d54ca92]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:27 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b93a012a-83b9-45ac-9def-4c7c8e52e807 tempest-GroupSnapshotsTest-726205531 None] group_snapshot 0fb143e2-5781-430b-b4de-2260ab20eef0: created successfully Jul 24 09:41:27 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce Jul 24 09:41:27 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:28 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce" returned: 0 in 0.399s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Creating direct copy from snapshot {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc98e037-6139-41ec-9fd7-515156c54a87]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:28 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] group_snapshot 0fb143e2-5781-430b-b4de-2260ab20eef0: deleting Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] group_snapshot 0fb143e2-5781-430b-b4de-2260ab20eef0: deleting {{(pid=88488) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "cinder-quobyte-2933d7b8-ff75-40ec-ac75-c06fbb23fa44" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:28 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 Jul 24 09:41:28 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-2933d7b8-ff75-40ec-ac75-c06fbb23fa44" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "cinder-quobyte-03c82747-32ab-44bf-a980-9563796fe094" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-03c82747-32ab-44bf-a980-9563796fe094" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Deleting offline snapshot 03c82747-32ab-44bf-a980-9563796fe094 of volume 2933d7b8-ff75-40ec-ac75-c06fbb23fa44 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] snapshot_file for this snap is: volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.03c82747-32ab-44bf-a980-9563796fe094 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[caef07c6-9d57-4b33-a689-9f731b2979ae]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.03c82747-32ab-44bf-a980-9563796fe094 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:28 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.03c82747-32ab-44bf-a980-9563796fe094 Jul 24 09:41:28 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:28 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50" returned: 0 in 0.460s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG cinder.utils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Path /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d632737f-8c69-4b4b-afef-41573cef4568 not found in is_blk_device check {{(pid=88488) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d632737f-8c69-4b4b-afef-41573cef4568 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:28 devstack sudo[94912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d632737f-8c69-4b4b-afef-41573cef4568 Jul 24 09:41:28 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:28 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.03c82747-32ab-44bf-a980-9563796fe094" returned: 0 in 0.559s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbe1835-fedf-4763-aa2b-6e9c9898925a]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:29 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44 Jul 24 09:41:29 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:29 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44" returned: 0 in 0.683s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.03c82747-32ab-44bf-a980-9563796fe094 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:29 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.03c82747-32ab-44bf-a980-9563796fe094 Jul 24 09:41:29 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:30 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.03c82747-32ab-44bf-a980-9563796fe094" returned: 0 in 1.160s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.03c82747-32ab-44bf-a980-9563796fe094 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:30 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.03c82747-32ab-44bf-a980-9563796fe094 Jul 24 09:41:31 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:31 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44.03c82747-32ab-44bf-a980-9563796fe094" returned: 0 in 0.864s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-03c82747-32ab-44bf-a980-9563796fe094" released by "_delete_snapshot" :: held 3.551s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-2933d7b8-ff75-40ec-ac75-c06fbb23fa44" released by "delete_snapshot" :: held 3.588s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "cinder-quobyte-bf861f30-5c2d-4f98-b43c-544db9064f50" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-bf861f30-5c2d-4f98-b43c-544db9064f50" acquired by "delete_snapshot" :: waited 0.053s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "cinder-quobyte-56320f39-4aea-4c0c-b477-ee00a2bf29b5" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-56320f39-4aea-4c0c-b477-ee00a2bf29b5" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Deleting offline snapshot 56320f39-4aea-4c0c-b477-ee00a2bf29b5 of volume bf861f30-5c2d-4f98-b43c-544db9064f50 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:41:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] snapshot_file for this snap is: volume-bf861f30-5c2d-4f98-b43c-544db9064f50.56320f39-4aea-4c0c-b477-ee00a2bf29b5 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:41:32 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0295e4a2-078a-429f-a555-449806cf3698]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.56320f39-4aea-4c0c-b477-ee00a2bf29b5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:32 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.56320f39-4aea-4c0c-b477-ee00a2bf29b5 Jul 24 09:41:32 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:33 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.56320f39-4aea-4c0c-b477-ee00a2bf29b5" returned: 0 in 1.316s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf861f30-5c2d-4f98-b43c-544db9064f50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:41:33 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[02eaf1b8-3c77-4eb4-907e-572497f81da8]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:34 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50 Jul 24 09:41:34 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:35 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50" returned: 0 in 1.348s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.56320f39-4aea-4c0c-b477-ee00a2bf29b5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:35 devstack sudo[94956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.56320f39-4aea-4c0c-b477-ee00a2bf29b5 Jul 24 09:41:35 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:35 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.56320f39-4aea-4c0c-b477-ee00a2bf29b5" returned: 0 in 0.867s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.56320f39-4aea-4c0c-b477-ee00a2bf29b5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:35 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.56320f39-4aea-4c0c-b477-ee00a2bf29b5 Jul 24 09:41:35 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:36 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d632737f-8c69-4b4b-afef-41573cef4568" returned: 0 in 7.817s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:36 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[68dc554c-e373-4207-9260-7d7cea1170ab]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:36 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50.56320f39-4aea-4c0c-b477-ee00a2bf29b5" returned: 0 in 0.616s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-56320f39-4aea-4c0c-b477-ee00a2bf29b5" released by "_delete_snapshot" :: held 4.427s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-bf861f30-5c2d-4f98-b43c-544db9064f50" released by "delete_snapshot" :: held 4.508s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:36 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 Jul 24 09:41:36 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:36 devstack cinder-volume[88488]: WARNING cinder.quota [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2020442234 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2020442234, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:41:36 devstack cinder-volume[88488]: WARNING cinder.quota [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2020442234 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2020442234, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:41:36 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Created reservations ['4d9d4599-19ae-4f1a-ac01-9cbd84cce60c', 'dcf49a7f-3024-490e-ae9c-7c1868e5cbeb', 'f6463ee5-7af8-4f6c-b5bf-c75f2e10dbd6', '155cb2d9-5d87-4d82-929d-185ac7a5c755'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:36 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] Created reservations ['749af4a5-5706-4c51-8c78-0d5e284c03d4', 'd10e75dd-e10a-46bc-8284-96c96210ef29', '9e4ee3c5-a79e-445e-9927-5f99c16dee81', '29f25d6d-292f-46de-abd0-1d3160e5a843'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:36 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Flow 'volume_create_manager' (b9a48c55-9163-488c-bc6c-7b6e4ec99178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cce6a4e-68bf-42ee-928e-040a160f3e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cce6a4e-68bf-42ee-928e-040a160f3e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-932897336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0018555-3be2-432b-b345-b60cb7587cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c91ec74a7dc4749a80f889e919e9dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:41:37Z,use_quota=True,user_id='bab53e5243fb44b1a20fbb6cee3f6475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2dc3de9-febb-462d-9d86-ad388d3cc6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2dc3de9-febb-462d-9d86-ad388d3cc6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee6f234-8a80-4a8f-8f9e-cb856656f989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee6f234-8a80-4a8f-8f9e-cb856656f989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0018555-3be2-432b-b345-b60cb7587cf8', 'volume_name': 'volume-e0018555-3be2-432b-b345-b60cb7587cf8', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad66091-a689-4a45-bb00-4d53019c523f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad66091-a689-4a45-bb00-4d53019c523f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51de460-224d-41a9-85bf-eeba41e7cd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:37 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Volume e0018555-3be2-432b-b345-b60cb7587cf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0018555-3be2-432b-b345-b60cb7587cf8', 'volume_size': 1} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:37 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-39f1d6a4-71ad-4075-9e1f-a6f746a6cf31 tempest-GroupSnapshotsTest-726205531 None] group_snapshot 0fb143e2-5781-430b-b4de-2260ab20eef0: deleted successfully Jul 24 09:41:37 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50" returned: 0 in 0.685s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50, size 1024.00 MB, duration 7.82 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d632737f-8c69-4b4b-afef-41573cef4568 {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:41:37 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Converted 1024.00 MB image at 130.98 MB/s Jul 24 09:41:37 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d632737f-8c69-4b4b-afef-41573cef4568 is being set with open permissions: ugo+rw Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d632737f-8c69-4b4b-afef-41573cef4568 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:37 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d632737f-8c69-4b4b-afef-41573cef4568 Jul 24 09:41:37 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:37 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d632737f-8c69-4b4b-afef-41573cef4568" returned: 0 in 0.251s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-d632737f-8c69-4b4b-afef-41573cef4568" released by "_copy_volume_from_snapshot" :: held 9.730s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-fd92449f-57bc-411c-a531-15687c136dce-d632737f-8c69-4b4b-afef-41573cef4568" released by "_create_volume_from_snapshot" :: held 9.771s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.803s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.374s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-932897336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0018555-3be2-432b-b345-b60cb7587cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c91ec74a7dc4749a80f889e919e9dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:41:37Z,use_quota=True,user_id='bab53e5243fb44b1a20fbb6cee3f6475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Creating volume e0018555-3be2-432b-b345-b60cb7587cf8 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:41:37 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e0018555-3be2-432b-b345-b60cb7587cf8 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=119,cinder:INSERT=26,cinder:UPDATE=107,cinder:DELETE=5 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:41:37 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e0018555-3be2-432b-b345-b60cb7587cf8 1073741824 Jul 24 09:41:37 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=117,cinder:INSERT=23,cinder:UPDATE=102,cinder:DELETE=6 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719799ba-41c9-413b-bc72-8f6a1156fe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d632737f-8c69-4b4b-afef-41573cef4568', 'volume_size': 1, 'snapshot_id': 'fd92449f-57bc-411c-a531-15687c136dce'}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7962bb73-5d1d-405c-81e9-04b97b0e752f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:37 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Volume volume-d632737f-8c69-4b4b-afef-41573cef4568 (d632737f-8c69-4b4b-afef-41573cef4568): created successfully Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7962bb73-5d1d-405c-81e9-04b97b0e752f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Flow 'volume_create_manager' (15b76324-2750-424f-9ab3-4df5f17d5fed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:41:37 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-6b4c949a-71e3-4ccd-b540-3661cf9a8615 tempest-VolumesDeleteCascade-1016207056 None] Created volume successfully. Jul 24 09:41:37 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e0018555-3be2-432b-b345-b60cb7587cf8 1073741824" returned: 0 in 0.513s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e0018555-3be2-432b-b345-b60cb7587cf8 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:38 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e0018555-3be2-432b-b345-b60cb7587cf8 Jul 24 09:41:38 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "cinder-quobyte-2933d7b8-ff75-40ec-ac75-c06fbb23fa44" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-2933d7b8-ff75-40ec-ac75-c06fbb23fa44" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:38 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e0018555-3be2-432b-b345-b60cb7587cf8" returned: 0 in 0.275s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51de460-224d-41a9-85bf-eeba41e7cd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0018555-3be2-432b-b345-b60cb7587cf8', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6291c00-ef84-4346-86af-a9113a79a3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[71177a67-e773-40bb-8378-63f98a960df7]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:38 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Volume volume-e0018555-3be2-432b-b345-b60cb7587cf8 (e0018555-3be2-432b-b345-b60cb7587cf8): created successfully Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6291c00-ef84-4346-86af-a9113a79a3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Flow 'volume_create_manager' (b9a48c55-9163-488c-bc6c-7b6e4ec99178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:41:38 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-3d1665e9-048a-4a48-885c-66e501a395a0 tempest-AttachVolumeTestJSON-426441744 None] Created volume successfully. Jul 24 09:41:38 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44 Jul 24 09:41:38 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:38 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44" returned: 0 in 0.411s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:38 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44 Jul 24 09:41:38 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "cinder-58e83d56-9455-4e59-b9fb-d64f25ae1f50-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-58e83d56-9455-4e59-b9fb-d64f25ae1f50-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Performing cascade delete. {{(pid=88488) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "cinder-fd92449f-57bc-411c-a531-15687c136dce-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-fd92449f-57bc-411c-a531-15687c136dce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "cinder-quobyte-58e83d56-9455-4e59-b9fb-d64f25ae1f50" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-58e83d56-9455-4e59-b9fb-d64f25ae1f50" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "cinder-quobyte-fd92449f-57bc-411c-a531-15687c136dce" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-fd92449f-57bc-411c-a531-15687c136dce" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Deleting offline snapshot fd92449f-57bc-411c-a531-15687c136dce of volume 58e83d56-9455-4e59-b9fb-d64f25ae1f50 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] snapshot_file for this snap is: volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab57408-ae8b-4b53-80bb-18fa406af53e]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:39 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2933d7b8-ff75-40ec-ac75-c06fbb23fa44" returned: 0 in 0.313s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:39 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-2933d7b8-ff75-40ec-ac75-c06fbb23fa44" released by "delete_volume" :: held 0.814s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:39 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "cinder-quobyte-bf861f30-5c2d-4f98-b43c-544db9064f50" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:39 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-bf861f30-5c2d-4f98-b43c-544db9064f50" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:39 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a146294-759d-43ac-8f20-a802898c52d3]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:39 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce Jul 24 09:41:39 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:39 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50 Jul 24 09:41:39 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:39 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce" returned: 0 in 0.450s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:41:39 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee9f6b5-5f3b-4bc8-ba3d-1b9fbc45b090]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:39 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 Jul 24 09:41:39 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:39 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50" returned: 0 in 0.560s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:39 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50 Jul 24 09:41:39 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:40 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50" returned: 0 in 0.563s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:40 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bf861f30-5c2d-4f98-b43c-544db9064f50" returned: 0 in 0.377s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:40 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce Jul 24 09:41:40 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-bf861f30-5c2d-4f98-b43c-544db9064f50" released by "delete_volume" :: held 1.023s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Created reservations ['65ef963d-b4ae-400a-89dd-67242d924c52'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:40 devstack cinder-volume[88488]: WARNING cinder.quota [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2020442234 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2020442234, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-54fd444a-03da-4a6c-9370-800ff6084a85 req-e690c3b6-14ba-45a5-af07-85083b5a34d6 tempest-AttachVolumeTestJSON-426441744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-54fd444a-03da-4a6c-9370-800ff6084a85 req-e690c3b6-14ba-45a5-af07-85083b5a34d6 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Created reservations ['f7e6aad8-45c4-4c30-b99d-b8963bf00d1e', '5b5738d7-f0e0-492f-8060-2d0312e850ae', '8c06b955-14f4-4d14-b3a2-fd2e177318c2', '88b44f01-6bc9-430e-9f4a-76eec299774a'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-54fd444a-03da-4a6c-9370-800ff6084a85 req-e690c3b6-14ba-45a5-af07-85083b5a34d6 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-54fd444a-03da-4a6c-9370-800ff6084a85 req-e690c3b6-14ba-45a5-af07-85083b5a34d6 tempest-AttachVolumeTestJSON-426441744 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-e0018555-3be2-432b-b345-b60cb7587cf8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b1cb5b5-cae7-43a9-b26f-9b3de4fdc59d', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:41:40 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-54fd444a-03da-4a6c-9370-800ff6084a85 req-e690c3b6-14ba-45a5-af07-85083b5a34d6 tempest-AttachVolumeTestJSON-426441744 None] attachment_update completed successfully. Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Created reservations ['9c3e8705-370e-47ab-8a12-6eff4e0d124d', '88308794-8701-49ea-8404-29bd9204ac09', '65427f59-dc93-4186-955a-ba3b6bed9a47', '31f7b25c-765c-458c-8013-31fc84ee2535'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:40 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce" returned: 0 in 0.508s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:40 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce Jul 24 09:41:40 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:40 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:41:40 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:40 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50.fd92449f-57bc-411c-a531-15687c136dce" returned: 0 in 0.355s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-fd92449f-57bc-411c-a531-15687c136dce" released by "_delete_snapshot" :: held 2.017s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-58e83d56-9455-4e59-b9fb-d64f25ae1f50" released by "delete_snapshot" :: held 2.055s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:41 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.393s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:41 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:41:41 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-5a5ac857-dd7d-44c6-ab25-7f9b74e94096 tempest-GroupSnapshotsTest-726205531 None] Delete group completed successfully. Jul 24 09:41:41 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Created reservations ['1f24d8d7-1200-4ecd-9ef6-562d1b8f61cc', 'd379d7d7-5c4f-46b7-a9a5-a886615ea9b1', 'dc5a474f-42f1-4b54-9b75-5881461516f1', 'e963a19f-e179-4d10-9451-520dcb616c47'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:41 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Delete snapshot completed successfully. Jul 24 09:41:41 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-fd92449f-57bc-411c-a531-15687c136dce-delete_snapshot" released by "delete_snapshot" :: held 2.264s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Snapshots deleted, issuing volume delete {{(pid=88488) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 24 09:41:41 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "cinder-quobyte-58e83d56-9455-4e59-b9fb-d64f25ae1f50" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:41 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-58e83d56-9455-4e59-b9fb-d64f25ae1f50" acquired by "delete_volume" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:41 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef0a637-ee4d-42e0-aeac-6395a405de6f]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:41 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 Jul 24 09:41:41 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:41 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c7ec3841-f772-41f4-9cde-ef5250038c4e tempest-GroupSnapshotsTest-726205531 None] Group tempest-GroupSnapshotsTest-Group-1546292918: creating Jul 24 09:41:41 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c7ec3841-f772-41f4-9cde-ef5250038c4e tempest-GroupSnapshotsTest-726205531 None] Group tempest-GroupSnapshotsTest-Group-1546292918: created successfully Jul 24 09:41:41 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c7ec3841-f772-41f4-9cde-ef5250038c4e tempest-GroupSnapshotsTest-726205531 None] Create group completed successfully. Jul 24 09:41:41 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50" returned: 0 in 0.410s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:41 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50 Jul 24 09:41:41 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:41 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e83d56-9455-4e59-b9fb-d64f25ae1f50" returned: 0 in 0.246s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:41 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-58e83d56-9455-4e59-b9fb-d64f25ae1f50" released by "delete_volume" :: held 0.723s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:41 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Created reservations ['f7e41453-0d02-4a95-bae1-930db15d6e71', 'af838e79-e0bf-4f99-bf18-db97c666b3b7', '1d6f5e09-03c1-46d6-8f19-65ddc381db70', '7b4f5ee1-63dc-40e9-a0cf-fe124e291994'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:42 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:42 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:42 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:41:42 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7cced077-7650-403a-8380-705e1853096e tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "cinder-d632737f-8c69-4b4b-afef-41573cef4568-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7cced077-7650-403a-8380-705e1853096e tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-d632737f-8c69-4b4b-afef-41573cef4568-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:42 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.302s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:42 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:41:42 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Deleted volume successfully. Jul 24 09:41:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7cced077-7650-403a-8380-705e1853096e tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "cinder-quobyte-d632737f-8c69-4b4b-afef-41573cef4568" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7cced077-7650-403a-8380-705e1853096e tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-d632737f-8c69-4b4b-afef-41573cef4568" acquired by "delete_volume" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c46c57d9-130d-4db3-9996-62cd92248154 tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-58e83d56-9455-4e59-b9fb-d64f25ae1f50-delete_volume" released by "delete_volume" :: held 3.590s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:42 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b573c7-38a6-47d2-8c49-fe86a32fae07]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7cced077-7650-403a-8380-705e1853096e tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d632737f-8c69-4b4b-afef-41573cef4568 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:42 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d632737f-8c69-4b4b-afef-41573cef4568 Jul 24 09:41:42 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:42 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7cced077-7650-403a-8380-705e1853096e tempest-VolumesDeleteCascade-1016207056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d632737f-8c69-4b4b-afef-41573cef4568" returned: 0 in 0.421s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7cced077-7650-403a-8380-705e1853096e tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d632737f-8c69-4b4b-afef-41573cef4568 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:42 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d632737f-8c69-4b4b-afef-41573cef4568 Jul 24 09:41:42 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Flow 'volume_create_manager' (cb62e7a5-1af5-4250-ba79-7fbb955a0db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be4b7d8-cccd-4acd-8b98-28a79c59e1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:43 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7cced077-7650-403a-8380-705e1853096e tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d632737f-8c69-4b4b-afef-41573cef4568" returned: 0 in 0.280s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be4b7d8-cccd-4acd-8b98-28a79c59e1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-285895099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57d91dc4-611f-4235-b4a6-b09c76d1b0f7,host='devstack@QuobyteHD#QuobyteHD',id=8f615bbc-c90d-4a37-a7f9-87acb7ff789a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2541545cdf43416686209d9c71856312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:41:43Z,use_quota=True,user_id='d9b0fdbea4bc426486e9dd2da77302bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7ef5f27-e74f-444d-ab99-c7f705ad5020),volume_type_id=c7ef5f27-e74f-444d-ab99-c7f705ad5020)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0732aed7-20eb-4aea-8388-5b01db4e39ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0732aed7-20eb-4aea-8388-5b01db4e39ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d709561-6db1-4d00-8963-dd5468c2d73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d709561-6db1-4d00-8963-dd5468c2d73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f615bbc-c90d-4a37-a7f9-87acb7ff789a', 'volume_name': 'volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed12d913-2948-4121-81a4-ca5d19bd832d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed12d913-2948-4121-81a4-ca5d19bd832d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0009af8e-0b2c-4c23-8305-bb004d6bc654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:43 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Volume 8f615bbc-c90d-4a37-a7f9-87acb7ff789a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a', 'volume_size': 1} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=57d91dc4-611f-4235-b4a6-b09c76d1b0f7,created_at=2026-07-24T07:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-285895099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57d91dc4-611f-4235-b4a6-b09c76d1b0f7,host='devstack@QuobyteHD#QuobyteHD',id=8f615bbc-c90d-4a37-a7f9-87acb7ff789a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2541545cdf43416686209d9c71856312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:41:43Z,use_quota=True,user_id='d9b0fdbea4bc426486e9dd2da77302bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7ef5f27-e74f-444d-ab99-c7f705ad5020),volume_type_id=c7ef5f27-e74f-444d-ab99-c7f705ad5020)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Creating volume 8f615bbc-c90d-4a37-a7f9-87acb7ff789a {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:41:43 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7cced077-7650-403a-8380-705e1853096e tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-quobyte-d632737f-8c69-4b4b-afef-41573cef4568" released by "delete_volume" :: held 0.810s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:43 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a 1073741824 Jul 24 09:41:43 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-7cced077-7650-403a-8380-705e1853096e tempest-VolumesDeleteCascade-1016207056 None] Created reservations ['14e023aa-a91c-456f-a9da-119a4bdb29df', '5a42c9b7-affa-48f6-9fc2-efccf7ee3205', 'ab5d41d4-a013-4834-be17-1c3e90e84217', '4a4afbc8-8153-4d39-9be6-e12c246c8be6'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7cced077-7650-403a-8380-705e1853096e tempest-VolumesDeleteCascade-1016207056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7cced077-7650-403a-8380-705e1853096e tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7cced077-7650-403a-8380-705e1853096e tempest-VolumesDeleteCascade-1016207056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7cced077-7650-403a-8380-705e1853096e tempest-VolumesDeleteCascade-1016207056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7cced077-7650-403a-8380-705e1853096e tempest-VolumesDeleteCascade-1016207056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7cced077-7650-403a-8380-705e1853096e tempest-VolumesDeleteCascade-1016207056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:43 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:41:43 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:43 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7cced077-7650-403a-8380-705e1853096e tempest-VolumesDeleteCascade-1016207056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.274s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-7cced077-7650-403a-8380-705e1853096e tempest-VolumesDeleteCascade-1016207056 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:41:43 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-7cced077-7650-403a-8380-705e1853096e tempest-VolumesDeleteCascade-1016207056 None] Deleted volume successfully. Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7cced077-7650-403a-8380-705e1853096e tempest-VolumesDeleteCascade-1016207056 None] Lock "cinder-d632737f-8c69-4b4b-afef-41573cef4568-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:43 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a 1073741824" returned: 0 in 0.483s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:43 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a Jul 24 09:41:43 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:44 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a" returned: 0 in 0.308s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:41:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0009af8e-0b2c-4c23-8305-bb004d6bc654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19eb74e8-3c34-48a1-9a6a-a435bb08c2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:44 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Volume volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a (8f615bbc-c90d-4a37-a7f9-87acb7ff789a): created successfully Jul 24 09:41:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19eb74e8-3c34-48a1-9a6a-a435bb08c2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Flow 'volume_create_manager' (cb62e7a5-1af5-4250-ba79-7fbb955a0db4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:41:44 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-30ba57da-3b30-4724-90c0-9692567c9300 tempest-GroupSnapshotsTest-726205531 None] Created volume successfully. Jul 24 09:41:44 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] GroupSnapshot d2928f06-ffbd-4857-a027-9bd0a7b467f6: creating. Jul 24 09:41:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] Group snapshot d2928f06-ffbd-4857-a027-9bd0a7b467f6: creating. {{(pid=88488) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 24 09:41:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] Creating offline snapshot 5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c of volume 8f615bbc-c90d-4a37-a7f9-87acb7ff789a {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:41:44 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4898782b-f1b6-4986-8df8-c2e9d8b45146]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:44 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a Jul 24 09:41:44 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:45 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a" returned: 0 in 0.557s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:45 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c 1G Jul 24 09:41:45 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:45 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c 1G" returned: 0 in 0.639s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:45 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c Jul 24 09:41:45 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:46 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c" returned: 0 in 0.358s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:46 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c is being set with open permissions: ugo+rw: NotImplementedError Jul 24 09:41:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:46 devstack sudo[95629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c Jul 24 09:41:46 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:46 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c" returned: 0 in 0.256s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:46 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.info Jul 24 09:41:46 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:47 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.info" returned: 0 in 0.506s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:47 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 09:41:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:47 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.info Jul 24 09:41:47 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:47 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.info" returned: 0 in 0.406s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.840s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:47 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-a9f07875-609c-4e22-93c1-cc3ca0ba5674 tempest-GroupSnapshotsTest-726205531 None] group_snapshot d2928f06-ffbd-4857-a027-9bd0a7b467f6: created successfully Jul 24 09:41:48 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] group_snapshot d2928f06-ffbd-4857-a027-9bd0a7b467f6: deleting Jul 24 09:41:48 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] group_snapshot d2928f06-ffbd-4857-a027-9bd0a7b467f6: deleting {{(pid=88488) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 24 09:41:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "cinder-quobyte-8f615bbc-c90d-4a37-a7f9-87acb7ff789a" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-8f615bbc-c90d-4a37-a7f9-87acb7ff789a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "cinder-quobyte-5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:48 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] Deleting offline snapshot 5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c of volume 8f615bbc-c90d-4a37-a7f9-87acb7ff789a {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:41:48 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] snapshot_file for this snap is: volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:41:48 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b1171d-250a-4e7f-8bd1-cc4eebb43a45]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:48 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c Jul 24 09:41:48 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:48 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c" returned: 0 in 0.516s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:48 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:41:48 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1731ca19-4cfa-4e46-8b96-d6e8be7aef7d]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:48 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a Jul 24 09:41:48 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:49 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a" returned: 0 in 0.468s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:49 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c Jul 24 09:41:49 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Flow 'volume_create_manager' (66d1b788-14c6-4c47-ae46-abb971f7551e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e09a3f8-4e90-46a4-beed-9c6547528bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e09a3f8-4e90-46a4-beed-9c6547528bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-582709185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2865c02e-b1e0-4452-b43c-959239d7592b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aab32d9e508422aa109923c2d83b3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:41:49Z,use_quota=True,user_id='15e832ae158f444f91d4635107405f42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebec254b-ee11-4d26-a8e4-b5573d6e49df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebec254b-ee11-4d26-a8e4-b5573d6e49df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2121ea-73b0-4b24-bb8f-0e67a549b813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2121ea-73b0-4b24-bb8f-0e67a549b813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2865c02e-b1e0-4452-b43c-959239d7592b', 'volume_name': 'volume-2865c02e-b1e0-4452-b43c-959239d7592b', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ae750f-78d7-467c-8b55-1324879083dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ae750f-78d7-467c-8b55-1324879083dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63cff49a-dc57-420b-a247-4e13521d10a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:49 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Volume 2865c02e-b1e0-4452-b43c-959239d7592b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2865c02e-b1e0-4452-b43c-959239d7592b', 'volume_size': 1} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-582709185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2865c02e-b1e0-4452-b43c-959239d7592b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aab32d9e508422aa109923c2d83b3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:41:49Z,use_quota=True,user_id='15e832ae158f444f91d4635107405f42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Creating volume 2865c02e-b1e0-4452-b43c-959239d7592b {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:41:49 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:41:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2865c02e-b1e0-4452-b43c-959239d7592b 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:49 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2865c02e-b1e0-4452-b43c-959239d7592b 1073741824 Jul 24 09:41:49 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:50 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c" returned: 0 in 0.715s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:50 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c Jul 24 09:41:50 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:50 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2865c02e-b1e0-4452-b43c-959239d7592b 1073741824" returned: 0 in 0.678s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2865c02e-b1e0-4452-b43c-959239d7592b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:50 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2865c02e-b1e0-4452-b43c-959239d7592b Jul 24 09:41:50 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:50 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a.5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c" returned: 0 in 0.346s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:50 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-5d2e8a5b-6d89-4cd3-97a1-78e9c21d9f2c" released by "_delete_snapshot" :: held 2.183s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:50 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-8f615bbc-c90d-4a37-a7f9-87acb7ff789a" released by "delete_snapshot" :: held 2.216s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:50 devstack cinder-volume[88488]: WARNING cinder.quota [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-265024614 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-265024614, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:41:50 devstack cinder-volume[88488]: WARNING cinder.quota [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-265024614 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-265024614, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:41:50 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] Created reservations ['eb7b83f8-24f8-45b2-b37f-2f714d5e4c76', 'ec0e0a84-513a-451f-9e4f-9a63389d812f', '4f9256b5-ab08-4cf8-987d-b877a0f58538', 'd82723b6-3ace-4a95-b310-32570aea12be'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:50 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-4f17ffae-f2a5-4037-833b-9dc19bc4936d tempest-GroupSnapshotsTest-726205531 None] group_snapshot d2928f06-ffbd-4857-a027-9bd0a7b467f6: deleted successfully Jul 24 09:41:50 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2865c02e-b1e0-4452-b43c-959239d7592b" returned: 0 in 0.300s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:50 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:41:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63cff49a-dc57-420b-a247-4e13521d10a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2865c02e-b1e0-4452-b43c-959239d7592b', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddba7e7-344b-464f-a35a-8e20c525ec7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:50 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Volume volume-2865c02e-b1e0-4452-b43c-959239d7592b (2865c02e-b1e0-4452-b43c-959239d7592b): created successfully Jul 24 09:41:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddba7e7-344b-464f-a35a-8e20c525ec7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Flow 'volume_create_manager' (66d1b788-14c6-4c47-ae46-abb971f7551e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:41:50 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-778ce98e-87a1-450b-b4ea-0733fa642376 tempest-VolumesTransfersTest-1588892186 None] Created volume successfully. Jul 24 09:41:50 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a39b165b-4b45-4ee1-87a6-913c00dc4e82 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "cinder-quobyte-8f615bbc-c90d-4a37-a7f9-87acb7ff789a" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:50 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a39b165b-4b45-4ee1-87a6-913c00dc4e82 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-8f615bbc-c90d-4a37-a7f9-87acb7ff789a" acquired by "delete_volume" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:51 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0b150c-40a5-44a8-99c0-56e636e7a814]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a39b165b-4b45-4ee1-87a6-913c00dc4e82 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:51 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a Jul 24 09:41:51 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:51 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a39b165b-4b45-4ee1-87a6-913c00dc4e82 tempest-GroupSnapshotsTest-726205531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a" returned: 0 in 0.410s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a39b165b-4b45-4ee1-87a6-913c00dc4e82 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:51 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a Jul 24 09:41:51 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:51 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a39b165b-4b45-4ee1-87a6-913c00dc4e82 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8f615bbc-c90d-4a37-a7f9-87acb7ff789a" returned: 0 in 0.335s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a39b165b-4b45-4ee1-87a6-913c00dc4e82 tempest-GroupSnapshotsTest-726205531 None] Lock "cinder-quobyte-8f615bbc-c90d-4a37-a7f9-87acb7ff789a" released by "delete_volume" :: held 0.828s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:51 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-a39b165b-4b45-4ee1-87a6-913c00dc4e82 tempest-GroupSnapshotsTest-726205531 None] Created reservations ['d96b6739-b047-43d4-a5ec-49516b50b6b9'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:51 devstack cinder-volume[88488]: WARNING cinder.quota [None req-a39b165b-4b45-4ee1-87a6-913c00dc4e82 tempest-GroupSnapshotsTest-726205531 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-265024614 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-265024614, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:41:51 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-a39b165b-4b45-4ee1-87a6-913c00dc4e82 tempest-GroupSnapshotsTest-726205531 None] Created reservations ['dc9e0e0d-a6fd-45ac-b9b8-c4588475020a', '0b4b8c37-e4c3-4846-9f47-6b24ffec1587', '7f0008c3-7c55-49a0-bbca-54da4951ac5b', '35585de7-4ebb-4eb4-be1d-2d52f9cfc9c2'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a39b165b-4b45-4ee1-87a6-913c00dc4e82 tempest-GroupSnapshotsTest-726205531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a39b165b-4b45-4ee1-87a6-913c00dc4e82 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a39b165b-4b45-4ee1-87a6-913c00dc4e82 tempest-GroupSnapshotsTest-726205531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a39b165b-4b45-4ee1-87a6-913c00dc4e82 tempest-GroupSnapshotsTest-726205531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a39b165b-4b45-4ee1-87a6-913c00dc4e82 tempest-GroupSnapshotsTest-726205531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a39b165b-4b45-4ee1-87a6-913c00dc4e82 tempest-GroupSnapshotsTest-726205531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:52 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:41:52 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Flow 'volume_create_manager' (72a0119d-222a-4157-a0b7-e0940c2faf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e769174-6830-44ba-b3bf-a7687d5bf5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e769174-6830-44ba-b3bf-a7687d5bf5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1257130173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4451ebb-e9ed-4ce9-9ece-44948ee18b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1580e98c9b4578a32eb24ec7885713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:41:52Z,use_quota=True,user_id='ba7b5c7a8deb4bbbbf3677ad360e3bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec608365-f28a-4691-ad7c-a14964aa74b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec608365-f28a-4691-ad7c-a14964aa74b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d292259-2578-4de1-a122-0377a86957bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d292259-2578-4de1-a122-0377a86957bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4451ebb-e9ed-4ce9-9ece-44948ee18b7d', 'volume_name': 'volume-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85b9f76-f0ec-4e21-ae1f-2960ebcd2b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85b9f76-f0ec-4e21-ae1f-2960ebcd2b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1d65a1-a68c-440a-b685-a9d39cfd0603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:52 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Volume c4451ebb-e9ed-4ce9-9ece-44948ee18b7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d', 'volume_size': 1} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1257130173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4451ebb-e9ed-4ce9-9ece-44948ee18b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1580e98c9b4578a32eb24ec7885713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:41:52Z,use_quota=True,user_id='ba7b5c7a8deb4bbbbf3677ad360e3bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Creating volume c4451ebb-e9ed-4ce9-9ece-44948ee18b7d {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:41:52 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:52 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-9b037de2-9b31-4d9e-b6a9-75868d7a5a57 tempest-VolumesTransfersTest-671614612 None] Transfer volume completed successfully. Jul 24 09:41:52 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d 1073741824 Jul 24 09:41:52 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:52 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a39b165b-4b45-4ee1-87a6-913c00dc4e82 tempest-GroupSnapshotsTest-726205531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.479s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:52 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-a39b165b-4b45-4ee1-87a6-913c00dc4e82 tempest-GroupSnapshotsTest-726205531 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:41:52 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-a39b165b-4b45-4ee1-87a6-913c00dc4e82 tempest-GroupSnapshotsTest-726205531 None] Delete group completed successfully. Jul 24 09:41:53 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d 1073741824" returned: 0 in 0.599s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:53 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d Jul 24 09:41:53 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f1c4a213-2819-4b52-afdc-9bc80a3bb0be tempest-VolumesTransfersTest-1359504423 None] Acquiring lock "cinder-2865c02e-b1e0-4452-b43c-959239d7592b-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f1c4a213-2819-4b52-afdc-9bc80a3bb0be tempest-VolumesTransfersTest-1359504423 None] Lock "cinder-2865c02e-b1e0-4452-b43c-959239d7592b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f1c4a213-2819-4b52-afdc-9bc80a3bb0be tempest-VolumesTransfersTest-1359504423 None] Acquiring lock "cinder-quobyte-2865c02e-b1e0-4452-b43c-959239d7592b" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f1c4a213-2819-4b52-afdc-9bc80a3bb0be tempest-VolumesTransfersTest-1359504423 None] Lock "cinder-quobyte-2865c02e-b1e0-4452-b43c-959239d7592b" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:53 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[61da6dd3-f2ca-486e-b859-7419f560dcf7]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f1c4a213-2819-4b52-afdc-9bc80a3bb0be tempest-VolumesTransfersTest-1359504423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2865c02e-b1e0-4452-b43c-959239d7592b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:53 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d" returned: 0 in 0.421s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:41:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1d65a1-a68c-440a-b685-a9d39cfd0603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37d9c84-00f7-4db7-8c21-0315fded368f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:53 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Volume volume-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d (c4451ebb-e9ed-4ce9-9ece-44948ee18b7d): created successfully Jul 24 09:41:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37d9c84-00f7-4db7-8c21-0315fded368f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Flow 'volume_create_manager' (72a0119d-222a-4157-a0b7-e0940c2faf51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:41:53 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c5160d73-0fdf-487a-8725-fdb1ff18e339 tempest-AttachVolumeNegativeTest-98594709 None] Created volume successfully. Jul 24 09:41:53 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2865c02e-b1e0-4452-b43c-959239d7592b Jul 24 09:41:53 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:53 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f1c4a213-2819-4b52-afdc-9bc80a3bb0be tempest-VolumesTransfersTest-1359504423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2865c02e-b1e0-4452-b43c-959239d7592b" returned: 0 in 0.393s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f1c4a213-2819-4b52-afdc-9bc80a3bb0be tempest-VolumesTransfersTest-1359504423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2865c02e-b1e0-4452-b43c-959239d7592b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:54 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2865c02e-b1e0-4452-b43c-959239d7592b Jul 24 09:41:54 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:54 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f1c4a213-2819-4b52-afdc-9bc80a3bb0be tempest-VolumesTransfersTest-1359504423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2865c02e-b1e0-4452-b43c-959239d7592b" returned: 0 in 0.287s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f1c4a213-2819-4b52-afdc-9bc80a3bb0be tempest-VolumesTransfersTest-1359504423 None] Lock "cinder-quobyte-2865c02e-b1e0-4452-b43c-959239d7592b" released by "delete_volume" :: held 0.728s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:54 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-f1c4a213-2819-4b52-afdc-9bc80a3bb0be tempest-VolumesTransfersTest-1359504423 None] Created reservations ['e604de8e-e582-4a15-a6b1-20b7353ecfff', '49de5060-b3a9-4ede-bf0e-ff83be0a78e5', 'c2cfd7b5-252d-420c-86bf-971147cbf730', '4e18c536-10b9-4082-824c-092bdaee8c36'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f1c4a213-2819-4b52-afdc-9bc80a3bb0be tempest-VolumesTransfersTest-1359504423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f1c4a213-2819-4b52-afdc-9bc80a3bb0be tempest-VolumesTransfersTest-1359504423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f1c4a213-2819-4b52-afdc-9bc80a3bb0be tempest-VolumesTransfersTest-1359504423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f1c4a213-2819-4b52-afdc-9bc80a3bb0be tempest-VolumesTransfersTest-1359504423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f1c4a213-2819-4b52-afdc-9bc80a3bb0be tempest-VolumesTransfersTest-1359504423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f1c4a213-2819-4b52-afdc-9bc80a3bb0be tempest-VolumesTransfersTest-1359504423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:54 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:41:54 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:54 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f1c4a213-2819-4b52-afdc-9bc80a3bb0be tempest-VolumesTransfersTest-1359504423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.311s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:54 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-f1c4a213-2819-4b52-afdc-9bc80a3bb0be tempest-VolumesTransfersTest-1359504423 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:41:54 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-f1c4a213-2819-4b52-afdc-9bc80a3bb0be tempest-VolumesTransfersTest-1359504423 None] Deleted volume successfully. Jul 24 09:41:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f1c4a213-2819-4b52-afdc-9bc80a3bb0be tempest-VolumesTransfersTest-1359504423 None] Lock "cinder-2865c02e-b1e0-4452-b43c-959239d7592b-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Flow 'volume_create_manager' (35a184e3-3c6d-4e37-8375-3a54d57c106b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850840e4-a29d-469c-b539-a30e6296d5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850840e4-a29d-469c-b539-a30e6296d5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-604128513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=074291b0-8ea0-4969-bf65-2962c27157f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aab32d9e508422aa109923c2d83b3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:41:56Z,use_quota=True,user_id='15e832ae158f444f91d4635107405f42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4030bae8-e83b-4a7f-83c0-83111bdc3bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4030bae8-e83b-4a7f-83c0-83111bdc3bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7155f6aa-49ba-4ecf-a5ed-56e23068651a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7155f6aa-49ba-4ecf-a5ed-56e23068651a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '074291b0-8ea0-4969-bf65-2962c27157f5', 'volume_name': 'volume-074291b0-8ea0-4969-bf65-2962c27157f5', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd17c6e8-ae99-4e94-a660-60b22908ddc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd17c6e8-ae99-4e94-a660-60b22908ddc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6793464e-49a0-4078-b228-62c29a142f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:55 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Volume 074291b0-8ea0-4969-bf65-2962c27157f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-074291b0-8ea0-4969-bf65-2962c27157f5', 'volume_size': 1} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-604128513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=074291b0-8ea0-4969-bf65-2962c27157f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aab32d9e508422aa109923c2d83b3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:41:56Z,use_quota=True,user_id='15e832ae158f444f91d4635107405f42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Creating volume 074291b0-8ea0-4969-bf65-2962c27157f5 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:41:55 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-074291b0-8ea0-4969-bf65-2962c27157f5 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:55 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-074291b0-8ea0-4969-bf65-2962c27157f5 1073741824 Jul 24 09:41:55 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-04f848dd-b27c-43d5-8670-1819d07f377e req-c528803f-5234-4240-8287-858bbbc41c9d tempest-AttachVolumeNegativeTest-98594709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:56 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-074291b0-8ea0-4969-bf65-2962c27157f5 1073741824" returned: 0 in 0.503s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-074291b0-8ea0-4969-bf65-2962c27157f5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:56 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-074291b0-8ea0-4969-bf65-2962c27157f5 Jul 24 09:41:56 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:56 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-074291b0-8ea0-4969-bf65-2962c27157f5" returned: 0 in 0.286s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:41:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-04f848dd-b27c-43d5-8670-1819d07f377e req-c528803f-5234-4240-8287-858bbbc41c9d tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.710s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-04f848dd-b27c-43d5-8670-1819d07f377e req-c528803f-5234-4240-8287-858bbbc41c9d tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6793464e-49a0-4078-b228-62c29a142f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-074291b0-8ea0-4969-bf65-2962c27157f5', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345158ea-df04-4906-ba32-b74a8d0e00f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:41:56 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Volume volume-074291b0-8ea0-4969-bf65-2962c27157f5 (074291b0-8ea0-4969-bf65-2962c27157f5): created successfully Jul 24 09:41:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345158ea-df04-4906-ba32-b74a8d0e00f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:41:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Flow 'volume_create_manager' (35a184e3-3c6d-4e37-8375-3a54d57c106b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:41:56 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-658c6458-27fc-4009-906f-cef4d99622af tempest-VolumesTransfersTest-1588892186 None] Created volume successfully. Jul 24 09:41:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-04f848dd-b27c-43d5-8670-1819d07f377e req-c528803f-5234-4240-8287-858bbbc41c9d tempest-AttachVolumeNegativeTest-98594709 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5fbe7db-81bb-4043-8ff3-d9abff92d12a', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:41:56 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-04f848dd-b27c-43d5-8670-1819d07f377e req-c528803f-5234-4240-8287-858bbbc41c9d tempest-AttachVolumeNegativeTest-98594709 None] attachment_update completed successfully. Jul 24 09:41:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2772b631-7e5c-4df0-88ed-77aaf73a3148 tempest-VolumesTransfersTest-1359504423 None] Acquiring lock "cinder-074291b0-8ea0-4969-bf65-2962c27157f5-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2772b631-7e5c-4df0-88ed-77aaf73a3148 tempest-VolumesTransfersTest-1359504423 None] Lock "cinder-074291b0-8ea0-4969-bf65-2962c27157f5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2772b631-7e5c-4df0-88ed-77aaf73a3148 tempest-VolumesTransfersTest-1359504423 None] Acquiring lock "cinder-quobyte-074291b0-8ea0-4969-bf65-2962c27157f5" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:41:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2772b631-7e5c-4df0-88ed-77aaf73a3148 tempest-VolumesTransfersTest-1359504423 None] Lock "cinder-quobyte-074291b0-8ea0-4969-bf65-2962c27157f5" acquired by "delete_volume" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:41:58 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a702fd9-f4a0-40a1-96e8-5c97085f2484]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:41:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2772b631-7e5c-4df0-88ed-77aaf73a3148 tempest-VolumesTransfersTest-1359504423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-074291b0-8ea0-4969-bf65-2962c27157f5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:58 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-074291b0-8ea0-4969-bf65-2962c27157f5 Jul 24 09:41:58 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:58 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2772b631-7e5c-4df0-88ed-77aaf73a3148 tempest-VolumesTransfersTest-1359504423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-074291b0-8ea0-4969-bf65-2962c27157f5" returned: 0 in 0.570s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2772b631-7e5c-4df0-88ed-77aaf73a3148 tempest-VolumesTransfersTest-1359504423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-074291b0-8ea0-4969-bf65-2962c27157f5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:58 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-074291b0-8ea0-4969-bf65-2962c27157f5 Jul 24 09:41:58 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:59 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-f4c3410b-0c15-41c2-8c70-d1868a9a151d req-3e260cc3-7d61-421e-ac8f-0fc37c64b264 tempest-AttachVolumeNegativeTest-98594709 None] Terminate volume connection completed successfully. Jul 24 09:41:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-f4c3410b-0c15-41c2-8c70-d1868a9a151d req-3e260cc3-7d61-421e-ac8f-0fc37c64b264 tempest-AttachVolumeNegativeTest-98594709 None] Deleting attachment d5fbe7db-81bb-4043-8ff3-d9abff92d12a. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:41:59 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2772b631-7e5c-4df0-88ed-77aaf73a3148 tempest-VolumesTransfersTest-1359504423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-074291b0-8ea0-4969-bf65-2962c27157f5" returned: 0 in 0.436s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2772b631-7e5c-4df0-88ed-77aaf73a3148 tempest-VolumesTransfersTest-1359504423 None] Lock "cinder-quobyte-074291b0-8ea0-4969-bf65-2962c27157f5" released by "delete_volume" :: held 1.070s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:41:59 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-2772b631-7e5c-4df0-88ed-77aaf73a3148 tempest-VolumesTransfersTest-1359504423 None] Created reservations ['abadb69a-2699-44eb-b0f3-43fcd8f8a9b3', 'ad299326-aa37-4fd5-90b0-75a5bbfc6eec', 'be374ab1-d149-4d77-aae9-95e38e324377', 'e5b7b22b-08bc-4ebd-94c9-354c3e1d77b0'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:41:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2772b631-7e5c-4df0-88ed-77aaf73a3148 tempest-VolumesTransfersTest-1359504423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:41:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2772b631-7e5c-4df0-88ed-77aaf73a3148 tempest-VolumesTransfersTest-1359504423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:41:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2772b631-7e5c-4df0-88ed-77aaf73a3148 tempest-VolumesTransfersTest-1359504423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:41:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2772b631-7e5c-4df0-88ed-77aaf73a3148 tempest-VolumesTransfersTest-1359504423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:41:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2772b631-7e5c-4df0-88ed-77aaf73a3148 tempest-VolumesTransfersTest-1359504423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:41:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2772b631-7e5c-4df0-88ed-77aaf73a3148 tempest-VolumesTransfersTest-1359504423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:41:59 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:41:59 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:41:59 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Jul 24 09:41:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2772b631-7e5c-4df0-88ed-77aaf73a3148 tempest-VolumesTransfersTest-1359504423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.311s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:41:59 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-2772b631-7e5c-4df0-88ed-77aaf73a3148 tempest-VolumesTransfersTest-1359504423 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:41:59 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-2772b631-7e5c-4df0-88ed-77aaf73a3148 tempest-VolumesTransfersTest-1359504423 None] Deleted volume successfully. Jul 24 09:41:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2772b631-7e5c-4df0-88ed-77aaf73a3148 tempest-VolumesTransfersTest-1359504423 None] Lock "cinder-074291b0-8ea0-4969-bf65-2962c27157f5-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-41121dad-f9c8-4768-8e76-e8a74c951a7a tempest-AttachVolumeNegativeTest-98594709 None] Acquiring lock "cinder-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-41121dad-f9c8-4768-8e76-e8a74c951a7a tempest-AttachVolumeNegativeTest-98594709 None] Lock "cinder-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-41121dad-f9c8-4768-8e76-e8a74c951a7a tempest-AttachVolumeNegativeTest-98594709 None] Acquiring lock "cinder-quobyte-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-41121dad-f9c8-4768-8e76-e8a74c951a7a tempest-AttachVolumeNegativeTest-98594709 None] Lock "cinder-quobyte-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d" acquired by "delete_volume" :: waited 0.024s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:05 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d5df25-ba9a-4ae2-a4b3-b1f60486bfd6]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-41121dad-f9c8-4768-8e76-e8a74c951a7a tempest-AttachVolumeNegativeTest-98594709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:05 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d Jul 24 09:42:05 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:05 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-41121dad-f9c8-4768-8e76-e8a74c951a7a tempest-AttachVolumeNegativeTest-98594709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d" returned: 0 in 0.431s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-41121dad-f9c8-4768-8e76-e8a74c951a7a tempest-AttachVolumeNegativeTest-98594709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:06 devstack sudo[96214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d Jul 24 09:42:06 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:06 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b5a78055-ecbf-47a6-b840-467b12defdd7 tempest-GroupsV320Test-893616146 None] Group tempest-GroupsV320Test-Group-100153197: creating Jul 24 09:42:06 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b5a78055-ecbf-47a6-b840-467b12defdd7 tempest-GroupsV320Test-893616146 None] Group tempest-GroupsV320Test-Group-100153197: created successfully Jul 24 09:42:06 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b5a78055-ecbf-47a6-b840-467b12defdd7 tempest-GroupsV320Test-893616146 None] Create group completed successfully. Jul 24 09:42:06 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-41121dad-f9c8-4768-8e76-e8a74c951a7a tempest-AttachVolumeNegativeTest-98594709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d" returned: 0 in 0.285s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-41121dad-f9c8-4768-8e76-e8a74c951a7a tempest-AttachVolumeNegativeTest-98594709 None] Lock "cinder-quobyte-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d" released by "delete_volume" :: held 0.774s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:06 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-41121dad-f9c8-4768-8e76-e8a74c951a7a tempest-AttachVolumeNegativeTest-98594709 None] Created reservations ['5faecc19-dcb9-465f-95dd-3580a7df1797', 'b4dbaaf3-f954-449b-9095-03e27eece469', 'e455ca6d-915f-4df3-86ee-16fdad1defb5', '508ee46a-99b7-44d6-8574-04e313f215e9'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:42:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-41121dad-f9c8-4768-8e76-e8a74c951a7a tempest-AttachVolumeNegativeTest-98594709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:42:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-41121dad-f9c8-4768-8e76-e8a74c951a7a tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:42:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-41121dad-f9c8-4768-8e76-e8a74c951a7a tempest-AttachVolumeNegativeTest-98594709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:42:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-41121dad-f9c8-4768-8e76-e8a74c951a7a tempest-AttachVolumeNegativeTest-98594709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:42:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-41121dad-f9c8-4768-8e76-e8a74c951a7a tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:42:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-41121dad-f9c8-4768-8e76-e8a74c951a7a tempest-AttachVolumeNegativeTest-98594709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:06 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:42:06 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:06 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-41121dad-f9c8-4768-8e76-e8a74c951a7a tempest-AttachVolumeNegativeTest-98594709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.250s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:06 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-41121dad-f9c8-4768-8e76-e8a74c951a7a tempest-AttachVolumeNegativeTest-98594709 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:42:06 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-41121dad-f9c8-4768-8e76-e8a74c951a7a tempest-AttachVolumeNegativeTest-98594709 None] Deleted volume successfully. Jul 24 09:42:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-41121dad-f9c8-4768-8e76-e8a74c951a7a tempest-AttachVolumeNegativeTest-98594709 None] Lock "cinder-c4451ebb-e9ed-4ce9-9ece-44948ee18b7d-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-27d2376b-00d9-475d-807e-d1736d0816ad tempest-AttachVolumeNegativeTest-98594709 None] Acquiring lock "cinder-564a3215-ff55-43f0-84d8-5a9adc07e2ac-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-27d2376b-00d9-475d-807e-d1736d0816ad tempest-AttachVolumeNegativeTest-98594709 None] Lock "cinder-564a3215-ff55-43f0-84d8-5a9adc07e2ac-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-27d2376b-00d9-475d-807e-d1736d0816ad tempest-AttachVolumeNegativeTest-98594709 None] Acquiring lock "cinder-quobyte-564a3215-ff55-43f0-84d8-5a9adc07e2ac" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-27d2376b-00d9-475d-807e-d1736d0816ad tempest-AttachVolumeNegativeTest-98594709 None] Lock "cinder-quobyte-564a3215-ff55-43f0-84d8-5a9adc07e2ac" acquired by "delete_volume" :: waited 0.023s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:06 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6acf74-4ec7-4a2f-9423-e09121b2352c]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-27d2376b-00d9-475d-807e-d1736d0816ad tempest-AttachVolumeNegativeTest-98594709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-564a3215-ff55-43f0-84d8-5a9adc07e2ac {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:06 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-564a3215-ff55-43f0-84d8-5a9adc07e2ac Jul 24 09:42:06 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:07 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-27d2376b-00d9-475d-807e-d1736d0816ad tempest-AttachVolumeNegativeTest-98594709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-564a3215-ff55-43f0-84d8-5a9adc07e2ac" returned: 0 in 0.389s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-27d2376b-00d9-475d-807e-d1736d0816ad tempest-AttachVolumeNegativeTest-98594709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-564a3215-ff55-43f0-84d8-5a9adc07e2ac {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:07 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-564a3215-ff55-43f0-84d8-5a9adc07e2ac Jul 24 09:42:07 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:07 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-27d2376b-00d9-475d-807e-d1736d0816ad tempest-AttachVolumeNegativeTest-98594709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-564a3215-ff55-43f0-84d8-5a9adc07e2ac" returned: 0 in 0.255s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-27d2376b-00d9-475d-807e-d1736d0816ad tempest-AttachVolumeNegativeTest-98594709 None] Lock "cinder-quobyte-564a3215-ff55-43f0-84d8-5a9adc07e2ac" released by "delete_volume" :: held 0.700s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-27d2376b-00d9-475d-807e-d1736d0816ad tempest-AttachVolumeNegativeTest-98594709 None] Created reservations ['1d0d4991-ec53-4b7f-94f5-f26c53f5868b', 'c00a0c2a-0949-4d27-9e1d-2283a286326b', '658c90b5-138c-4160-8ce9-5b8a75370bf6', '49c08082-6360-486c-bc3f-2fbce0fa5a73'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-27d2376b-00d9-475d-807e-d1736d0816ad tempest-AttachVolumeNegativeTest-98594709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-27d2376b-00d9-475d-807e-d1736d0816ad tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-27d2376b-00d9-475d-807e-d1736d0816ad tempest-AttachVolumeNegativeTest-98594709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-27d2376b-00d9-475d-807e-d1736d0816ad tempest-AttachVolumeNegativeTest-98594709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-27d2376b-00d9-475d-807e-d1736d0816ad tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-27d2376b-00d9-475d-807e-d1736d0816ad tempest-AttachVolumeNegativeTest-98594709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:07 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:42:07 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Flow 'volume_create_manager' (bf0e8002-ee5f-40d8-b6b1-8e002979659d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773d62cb-a143-4c90-a1f4-0baab7d7201c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773d62cb-a143-4c90-a1f4-0baab7d7201c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-124643448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd7e7e9-4401-4c1c-ab36-4158b101d57d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d65701237de247479068064db9af86e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:42:08Z,use_quota=True,user_id='04fc2720c68e407fbf4bd3f66c841151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be92d050-56ea-425a-a78c-a67790d56748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be92d050-56ea-425a-a78c-a67790d56748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7f863e-5ac4-4bb2-ae5f-fea4a6c93f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7f863e-5ac4-4bb2-ae5f-fea4a6c93f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acd7e7e9-4401-4c1c-ab36-4158b101d57d', 'volume_name': 'volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb37d18-7962-4418-95ba-116ccd70d1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb37d18-7962-4418-95ba-116ccd70d1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4c8730-3ff5-4890-aafb-605096218af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:07 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Volume acd7e7e9-4401-4c1c-ab36-4158b101d57d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d', 'volume_size': 1} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-124643448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd7e7e9-4401-4c1c-ab36-4158b101d57d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d65701237de247479068064db9af86e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:42:08Z,use_quota=True,user_id='04fc2720c68e407fbf4bd3f66c841151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Creating volume acd7e7e9-4401-4c1c-ab36-4158b101d57d {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:42:07 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:07 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d 1073741824 Jul 24 09:42:07 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-48908d76-efc1-4274-ad34-97eb6487f206 tempest-GroupsV320Test-893616146 None] Created reservations ['8d4cfd7d-c17b-46e4-bc8d-e7b874ae1f51'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-48908d76-efc1-4274-ad34-97eb6487f206 tempest-GroupsV320Test-893616146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-48908d76-efc1-4274-ad34-97eb6487f206 tempest-GroupsV320Test-893616146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-48908d76-efc1-4274-ad34-97eb6487f206 tempest-GroupsV320Test-893616146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-48908d76-efc1-4274-ad34-97eb6487f206 tempest-GroupsV320Test-893616146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-48908d76-efc1-4274-ad34-97eb6487f206 tempest-GroupsV320Test-893616146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-48908d76-efc1-4274-ad34-97eb6487f206 tempest-GroupsV320Test-893616146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:07 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:42:07 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:07 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-27d2376b-00d9-475d-807e-d1736d0816ad tempest-AttachVolumeNegativeTest-98594709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.323s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:07 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-27d2376b-00d9-475d-807e-d1736d0816ad tempest-AttachVolumeNegativeTest-98594709 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:42:07 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-27d2376b-00d9-475d-807e-d1736d0816ad tempest-AttachVolumeNegativeTest-98594709 None] Deleted volume successfully. Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-27d2376b-00d9-475d-807e-d1736d0816ad tempest-AttachVolumeNegativeTest-98594709 None] Lock "cinder-564a3215-ff55-43f0-84d8-5a9adc07e2ac-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f6cbab0a-6fd5-4140-a003-d317c6088bd9 tempest-AttachVolumeNegativeTest-98594709 None] Acquiring lock "cinder-6714f26b-22a9-40d2-a530-2745b25b3024-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:08 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-48908d76-efc1-4274-ad34-97eb6487f206 tempest-GroupsV320Test-893616146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.256s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-48908d76-efc1-4274-ad34-97eb6487f206 tempest-GroupsV320Test-893616146 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:42:08 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-48908d76-efc1-4274-ad34-97eb6487f206 tempest-GroupsV320Test-893616146 None] Delete group completed successfully. Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f6cbab0a-6fd5-4140-a003-d317c6088bd9 tempest-AttachVolumeNegativeTest-98594709 None] Lock "cinder-6714f26b-22a9-40d2-a530-2745b25b3024-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f6cbab0a-6fd5-4140-a003-d317c6088bd9 tempest-AttachVolumeNegativeTest-98594709 None] Acquiring lock "cinder-quobyte-6714f26b-22a9-40d2-a530-2745b25b3024" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f6cbab0a-6fd5-4140-a003-d317c6088bd9 tempest-AttachVolumeNegativeTest-98594709 None] Lock "cinder-quobyte-6714f26b-22a9-40d2-a530-2745b25b3024" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb9f65d-bcc9-41fc-87eb-f1e5eb198462]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f6cbab0a-6fd5-4140-a003-d317c6088bd9 tempest-AttachVolumeNegativeTest-98594709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6714f26b-22a9-40d2-a530-2745b25b3024 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:08 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d 1073741824" returned: 0 in 0.522s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:08 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6714f26b-22a9-40d2-a530-2745b25b3024 Jul 24 09:42:08 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:08 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d Jul 24 09:42:08 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:08 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:08 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f6cbab0a-6fd5-4140-a003-d317c6088bd9 tempest-AttachVolumeNegativeTest-98594709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6714f26b-22a9-40d2-a530-2745b25b3024" returned: 0 in 0.361s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f6cbab0a-6fd5-4140-a003-d317c6088bd9 tempest-AttachVolumeNegativeTest-98594709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6714f26b-22a9-40d2-a530-2745b25b3024 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d" returned: 0 in 0.273s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:42:08 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6714f26b-22a9-40d2-a530-2745b25b3024 Jul 24 09:42:08 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4c8730-3ff5-4890-aafb-605096218af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347dd40e-6492-4719-b1c7-6441983b65af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:08 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Volume volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d (acd7e7e9-4401-4c1c-ab36-4158b101d57d): created successfully Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347dd40e-6492-4719-b1c7-6441983b65af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Flow 'volume_create_manager' (bf0e8002-ee5f-40d8-b6b1-8e002979659d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:42:08 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-96c6a015-8754-4cfe-af2c-5044cb0a38d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Created volume successfully. Jul 24 09:42:08 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f6cbab0a-6fd5-4140-a003-d317c6088bd9 tempest-AttachVolumeNegativeTest-98594709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-6714f26b-22a9-40d2-a530-2745b25b3024" returned: 0 in 0.255s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f6cbab0a-6fd5-4140-a003-d317c6088bd9 tempest-AttachVolumeNegativeTest-98594709 None] Lock "cinder-quobyte-6714f26b-22a9-40d2-a530-2745b25b3024" released by "delete_volume" :: held 0.659s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:08 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-f6cbab0a-6fd5-4140-a003-d317c6088bd9 tempest-AttachVolumeNegativeTest-98594709 None] Created reservations ['085bc3d1-3d19-471c-9f00-77c9248d5fac', 'f0147eac-d6a1-4437-87dc-4ca3320f6408', '5f68d2ef-2d7c-4aac-a7a2-5cfc86420b0e', '1bb0ae9c-2927-48ba-a3a3-445d1a7ee090'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:42:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f6cbab0a-6fd5-4140-a003-d317c6088bd9 tempest-AttachVolumeNegativeTest-98594709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:42:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f6cbab0a-6fd5-4140-a003-d317c6088bd9 tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:42:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f6cbab0a-6fd5-4140-a003-d317c6088bd9 tempest-AttachVolumeNegativeTest-98594709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:42:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f6cbab0a-6fd5-4140-a003-d317c6088bd9 tempest-AttachVolumeNegativeTest-98594709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:42:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f6cbab0a-6fd5-4140-a003-d317c6088bd9 tempest-AttachVolumeNegativeTest-98594709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:42:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f6cbab0a-6fd5-4140-a003-d317c6088bd9 tempest-AttachVolumeNegativeTest-98594709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:09 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:42:09 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:09 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f6cbab0a-6fd5-4140-a003-d317c6088bd9 tempest-AttachVolumeNegativeTest-98594709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.273s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:09 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-f6cbab0a-6fd5-4140-a003-d317c6088bd9 tempest-AttachVolumeNegativeTest-98594709 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:42:09 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-f6cbab0a-6fd5-4140-a003-d317c6088bd9 tempest-AttachVolumeNegativeTest-98594709 None] Deleted volume successfully. Jul 24 09:42:09 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f6cbab0a-6fd5-4140-a003-d317c6088bd9 tempest-AttachVolumeNegativeTest-98594709 None] Lock "cinder-6714f26b-22a9-40d2-a530-2745b25b3024-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-481c2bc5-354f-4e30-92b0-ff744037c399 tempest-VolumesSnapshotListTestJSON-1039835064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:42:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-481c2bc5-354f-4e30-92b0-ff744037c399 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:42:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-481c2bc5-354f-4e30-92b0-ff744037c399 tempest-VolumesSnapshotListTestJSON-1039835064 None] Creating offline snapshot 77c76a19-d59f-45bc-9a8d-484da7e256bf of volume acd7e7e9-4401-4c1c-ab36-4158b101d57d {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:42:10 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8fff24-53b1-4113-84ef-946346706a64]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-481c2bc5-354f-4e30-92b0-ff744037c399 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:10 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d Jul 24 09:42:10 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:10 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-481c2bc5-354f-4e30-92b0-ff744037c399 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d" returned: 0 in 0.425s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-481c2bc5-354f-4e30-92b0-ff744037c399 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:10 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf 1G Jul 24 09:42:10 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:11 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-481c2bc5-354f-4e30-92b0-ff744037c399 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf 1G" returned: 0 in 0.602s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-481c2bc5-354f-4e30-92b0-ff744037c399 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:11 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf Jul 24 09:42:11 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:11 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-481c2bc5-354f-4e30-92b0-ff744037c399 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf" returned: 0 in 0.418s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:11 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-481c2bc5-354f-4e30-92b0-ff744037c399 tempest-VolumesSnapshotListTestJSON-1039835064 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf is being set with open permissions: ugo+rw Jul 24 09:42:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-481c2bc5-354f-4e30-92b0-ff744037c399 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:11 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf Jul 24 09:42:11 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:11 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-481c2bc5-354f-4e30-92b0-ff744037c399 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf" returned: 0 in 0.314s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-481c2bc5-354f-4e30-92b0-ff744037c399 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:12 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.info Jul 24 09:42:12 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:12 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-481c2bc5-354f-4e30-92b0-ff744037c399 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.info" returned: 0 in 0.276s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:12 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-481c2bc5-354f-4e30-92b0-ff744037c399 tempest-VolumesSnapshotListTestJSON-1039835064 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.info is being set with open permissions: ugo+rw Jul 24 09:42:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-481c2bc5-354f-4e30-92b0-ff744037c399 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:12 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.info Jul 24 09:42:12 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:12 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-481c2bc5-354f-4e30-92b0-ff744037c399 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.info" returned: 0 in 0.289s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-481c2bc5-354f-4e30-92b0-ff744037c399 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.445s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:42:12 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-481c2bc5-354f-4e30-92b0-ff744037c399 tempest-VolumesSnapshotListTestJSON-1039835064 None] Create snapshot completed successfully Jul 24 09:42:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-25a2c1ca-64ec-4a7b-a009-7972b88d70a0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:42:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-25a2c1ca-64ec-4a7b-a009-7972b88d70a0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:42:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-25a2c1ca-64ec-4a7b-a009-7972b88d70a0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Creating offline snapshot 3760d7b5-d7c8-4e75-b217-89fca88f9a89 of volume acd7e7e9-4401-4c1c-ab36-4158b101d57d {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:42:13 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a147fe-bf35-4568-9920-c8b3d6acd688]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-25a2c1ca-64ec-4a7b-a009-7972b88d70a0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:13 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf Jul 24 09:42:13 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:14 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-25a2c1ca-64ec-4a7b-a009-7972b88d70a0 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf" returned: 0 in 0.528s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-25a2c1ca-64ec-4a7b-a009-7972b88d70a0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:42:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-25a2c1ca-64ec-4a7b-a009-7972b88d70a0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:14 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 1G Jul 24 09:42:14 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:14 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-b19f4a64-a212-41e0-82d8-94e4cf878d24 req-76cc9fd3-dc02-44b4-80bd-a5c5a596347e tempest-AttachVolumeTestJSON-426441744 None] Terminate volume connection completed successfully. Jul 24 09:42:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-b19f4a64-a212-41e0-82d8-94e4cf878d24 req-76cc9fd3-dc02-44b4-80bd-a5c5a596347e tempest-AttachVolumeTestJSON-426441744 None] Deleting attachment 1b1cb5b5-cae7-43a9-b26f-9b3de4fdc59d. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:42:14 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-25a2c1ca-64ec-4a7b-a009-7972b88d70a0 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 1G" returned: 0 in 0.564s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-25a2c1ca-64ec-4a7b-a009-7972b88d70a0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:14 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 Jul 24 09:42:14 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:42:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 8 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:42:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:42:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-25a2c1ca-64ec-4a7b-a009-7972b88d70a0 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89" returned: 0 in 0.396s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:15 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:15 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-25a2c1ca-64ec-4a7b-a009-7972b88d70a0 tempest-VolumesSnapshotListTestJSON-1039835064 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 is being set with open permissions: ugo+rw Jul 24 09:42:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-25a2c1ca-64ec-4a7b-a009-7972b88d70a0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:15 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 Jul 24 09:42:15 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:15 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-25a2c1ca-64ec-4a7b-a009-7972b88d70a0 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89" returned: 0 in 0.342s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-25a2c1ca-64ec-4a7b-a009-7972b88d70a0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:42:15 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-25a2c1ca-64ec-4a7b-a009-7972b88d70a0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Create snapshot completed successfully Jul 24 09:42:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d7605a75-adb6-455a-b79a-ae0e8aa345d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:42:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d7605a75-adb6-455a-b79a-ae0e8aa345d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:42:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-d7605a75-adb6-455a-b79a-ae0e8aa345d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Creating offline snapshot 4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f of volume acd7e7e9-4401-4c1c-ab36-4158b101d57d {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:42:15 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb72d027-e3cc-46b5-9588-a1e42a95da98]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d7605a75-adb6-455a-b79a-ae0e8aa345d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:16 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 Jul 24 09:42:16 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:16 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d7605a75-adb6-455a-b79a-ae0e8aa345d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89" returned: 0 in 0.431s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-d7605a75-adb6-455a-b79a-ae0e8aa345d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:42:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d7605a75-adb6-455a-b79a-ae0e8aa345d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:16 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f 1G Jul 24 09:42:16 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:16 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d7605a75-adb6-455a-b79a-ae0e8aa345d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f 1G" returned: 0 in 0.637s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d7605a75-adb6-455a-b79a-ae0e8aa345d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:17 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f Jul 24 09:42:17 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:17 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d7605a75-adb6-455a-b79a-ae0e8aa345d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f" returned: 0 in 0.442s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:17 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-d7605a75-adb6-455a-b79a-ae0e8aa345d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f is being set with open permissions: ugo+rw Jul 24 09:42:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d7605a75-adb6-455a-b79a-ae0e8aa345d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:17 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f Jul 24 09:42:17 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:17 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d7605a75-adb6-455a-b79a-ae0e8aa345d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f" returned: 0 in 0.357s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d7605a75-adb6-455a-b79a-ae0e8aa345d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.044s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:42:17 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d7605a75-adb6-455a-b79a-ae0e8aa345d0 tempest-VolumesSnapshotListTestJSON-1039835064 None] Create snapshot completed successfully Jul 24 09:42:18 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Flow 'volume_create_manager' (6122db5d-e669-4ba2-9e05-d2862bb0f779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab153d20-7b54-4317-b407-cfad3154090b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab153d20-7b54-4317-b407-cfad3154090b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1158973784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a96798f0-aee5-4bb5-8daa-c661501e2050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a979d5d2327242af9e5235a82164134f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:42:19Z,use_quota=True,user_id='6c40901545cf472c9a98f67309bc9401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d78a9a-74c4-43ba-b061-2059e61b382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d78a9a-74c4-43ba-b061-2059e61b382d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5ad00f-0be1-4b8d-acfb-4233c1970024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5ad00f-0be1-4b8d-acfb-4233c1970024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a96798f0-aee5-4bb5-8daa-c661501e2050', 'volume_name': 'volume-a96798f0-aee5-4bb5-8daa-c661501e2050', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa525cb6-b744-49d9-b9b3-663ef587f65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa525cb6-b744-49d9-b9b3-663ef587f65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc8a06e-4e93-48b7-bb2f-abc6649b263d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:19 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Volume a96798f0-aee5-4bb5-8daa-c661501e2050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a96798f0-aee5-4bb5-8daa-c661501e2050', 'volume_size': 1} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1158973784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a96798f0-aee5-4bb5-8daa-c661501e2050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a979d5d2327242af9e5235a82164134f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:42:19Z,use_quota=True,user_id='6c40901545cf472c9a98f67309bc9401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Creating volume a96798f0-aee5-4bb5-8daa-c661501e2050 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:42:19 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:19 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050 1073741824 Jul 24 09:42:19 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:19 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050 1073741824" returned: 0 in 0.718s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:20 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050 Jul 24 09:42:20 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:20 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050" returned: 0 in 0.434s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:20 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:42:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:42:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc8a06e-4e93-48b7-bb2f-abc6649b263d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a96798f0-aee5-4bb5-8daa-c661501e2050', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4000c681-2a85-4e6f-afd3-ebe5308ba368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] Acquiring lock "cinder-4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:20 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Volume volume-a96798f0-aee5-4bb5-8daa-c661501e2050 (a96798f0-aee5-4bb5-8daa-c661501e2050): created successfully Jul 24 09:42:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4000c681-2a85-4e6f-afd3-ebe5308ba368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Flow 'volume_create_manager' (6122db5d-e669-4ba2-9e05-d2862bb0f779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:42:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] Acquiring lock "cinder-quobyte-acd7e7e9-4401-4c1c-ab36-4158b101d57d" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:20 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-7b53b02c-2e09-4a54-b232-9fabbc29f908 req-ffaf1a5b-b14c-47a1-a7cb-bb03e6c83759 tempest-VolumesSnapshotsTestJSON-2107033434 None] Created volume successfully. Jul 24 09:42:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-quobyte-acd7e7e9-4401-4c1c-ab36-4158b101d57d" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] Acquiring lock "cinder-quobyte-4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-quobyte-4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:20 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] Deleting offline snapshot 4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f of volume acd7e7e9-4401-4c1c-ab36-4158b101d57d {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:42:20 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] snapshot_file for this snap is: volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:42:20 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f789e6aa-3ff6-4413-b021-579706020ae2]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:20 devstack sudo[96474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f Jul 24 09:42:20 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:21 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f" returned: 0 in 0.527s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:21 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:42:21 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f750edda-03d6-43aa-ace4-2609011f8527]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:21 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 Jul 24 09:42:21 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:21 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89" returned: 0 in 0.491s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:21 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:42:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-05ee1408-24f1-48ce-b61d-07ac7dbdd2b7 req-e1321592-bb26-435d-8984-52b71a4271d7 tempest-VolumesSnapshotsTestJSON-2107033434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:42:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-05ee1408-24f1-48ce-b61d-07ac7dbdd2b7 req-e1321592-bb26-435d-8984-52b71a4271d7 tempest-VolumesSnapshotsTestJSON-2107033434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:42:21 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f Jul 24 09:42:21 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:21 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [req-05ee1408-24f1-48ce-b61d-07ac7dbdd2b7 req-e1321592-bb26-435d-8984-52b71a4271d7 tempest-VolumesSnapshotsTestJSON-2107033434 None] Creating offline snapshot 6f3eca02-c429-415a-9b3e-9e012d9cecc1 of volume a96798f0-aee5-4bb5-8daa-c661501e2050 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:42:21 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7760ff0f-225f-4563-8d61-b5b1d8588b3d]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-05ee1408-24f1-48ce-b61d-07ac7dbdd2b7 req-e1321592-bb26-435d-8984-52b71a4271d7 tempest-VolumesSnapshotsTestJSON-2107033434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:22 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050 Jul 24 09:42:22 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:22 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-05ee1408-24f1-48ce-b61d-07ac7dbdd2b7 req-e1321592-bb26-435d-8984-52b71a4271d7 tempest-VolumesSnapshotsTestJSON-2107033434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050" returned: 0 in 0.534s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-05ee1408-24f1-48ce-b61d-07ac7dbdd2b7 req-e1321592-bb26-435d-8984-52b71a4271d7 tempest-VolumesSnapshotsTestJSON-2107033434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.6f3eca02-c429-415a-9b3e-9e012d9cecc1 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:22 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.6f3eca02-c429-415a-9b3e-9e012d9cecc1 1G Jul 24 09:42:22 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:22 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f" returned: 0 in 0.824s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:22 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f Jul 24 09:42:22 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:23 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f" returned: 0 in 0.433s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-quobyte-4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f" released by "_delete_snapshot" :: held 2.431s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-quobyte-acd7e7e9-4401-4c1c-ab36-4158b101d57d" released by "delete_snapshot" :: held 2.473s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:23 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] Created reservations ['df8616bb-0da3-4c56-a858-155d7c658758', '21281f09-bba0-4e52-af14-2f747136184e', 'e3d0ffa2-6ddd-4353-8046-d2a9334346bf', 'e837afcc-5b4a-4065-a0ae-078aa42d7ae0'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:42:23 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-05ee1408-24f1-48ce-b61d-07ac7dbdd2b7 req-e1321592-bb26-435d-8984-52b71a4271d7 tempest-VolumesSnapshotsTestJSON-2107033434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.6f3eca02-c429-415a-9b3e-9e012d9cecc1 1G" returned: 0 in 0.737s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-05ee1408-24f1-48ce-b61d-07ac7dbdd2b7 req-e1321592-bb26-435d-8984-52b71a4271d7 tempest-VolumesSnapshotsTestJSON-2107033434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96798f0-aee5-4bb5-8daa-c661501e2050 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.6f3eca02-c429-415a-9b3e-9e012d9cecc1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:23 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96798f0-aee5-4bb5-8daa-c661501e2050 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.6f3eca02-c429-415a-9b3e-9e012d9cecc1 Jul 24 09:42:23 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:23 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] Delete snapshot completed successfully. Jul 24 09:42:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-defdc471-6742-45a9-969b-0ff066bbb746 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-4c9d9c2c-37a6-43d0-9126-388c6c6c7e6f-delete_snapshot" released by "delete_snapshot" :: held 2.700s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:23 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-05ee1408-24f1-48ce-b61d-07ac7dbdd2b7 req-e1321592-bb26-435d-8984-52b71a4271d7 tempest-VolumesSnapshotsTestJSON-2107033434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96798f0-aee5-4bb5-8daa-c661501e2050 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.6f3eca02-c429-415a-9b3e-9e012d9cecc1" returned: 0 in 0.390s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:23 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [req-05ee1408-24f1-48ce-b61d-07ac7dbdd2b7 req-e1321592-bb26-435d-8984-52b71a4271d7 tempest-VolumesSnapshotsTestJSON-2107033434 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.6f3eca02-c429-415a-9b3e-9e012d9cecc1 is being set with open permissions: ugo+rw Jul 24 09:42:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-05ee1408-24f1-48ce-b61d-07ac7dbdd2b7 req-e1321592-bb26-435d-8984-52b71a4271d7 tempest-VolumesSnapshotsTestJSON-2107033434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.6f3eca02-c429-415a-9b3e-9e012d9cecc1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:23 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.6f3eca02-c429-415a-9b3e-9e012d9cecc1 Jul 24 09:42:23 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] Acquiring lock "cinder-3760d7b5-d7c8-4e75-b217-89fca88f9a89-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:23 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-05ee1408-24f1-48ce-b61d-07ac7dbdd2b7 req-e1321592-bb26-435d-8984-52b71a4271d7 tempest-VolumesSnapshotsTestJSON-2107033434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.6f3eca02-c429-415a-9b3e-9e012d9cecc1" returned: 0 in 0.335s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-3760d7b5-d7c8-4e75-b217-89fca88f9a89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] Acquiring lock "cinder-quobyte-acd7e7e9-4401-4c1c-ab36-4158b101d57d" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-quobyte-acd7e7e9-4401-4c1c-ab36-4158b101d57d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] Acquiring lock "cinder-quobyte-3760d7b5-d7c8-4e75-b217-89fca88f9a89" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-05ee1408-24f1-48ce-b61d-07ac7dbdd2b7 req-e1321592-bb26-435d-8984-52b71a4271d7 tempest-VolumesSnapshotsTestJSON-2107033434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-quobyte-3760d7b5-d7c8-4e75-b217-89fca88f9a89" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] Deleting offline snapshot 3760d7b5-d7c8-4e75-b217-89fca88f9a89 of volume acd7e7e9-4401-4c1c-ab36-4158b101d57d {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:42:23 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.info Jul 24 09:42:23 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] snapshot_file for this snap is: volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:42:24 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87d4d28-3e4b-443b-a088-6be1460189a5]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:24 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 Jul 24 09:42:24 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:24 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-05ee1408-24f1-48ce-b61d-07ac7dbdd2b7 req-e1321592-bb26-435d-8984-52b71a4271d7 tempest-VolumesSnapshotsTestJSON-2107033434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.info" returned: 0 in 0.369s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:24 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [req-05ee1408-24f1-48ce-b61d-07ac7dbdd2b7 req-e1321592-bb26-435d-8984-52b71a4271d7 tempest-VolumesSnapshotsTestJSON-2107033434 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.info is being set with open permissions: ugo+rw Jul 24 09:42:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-05ee1408-24f1-48ce-b61d-07ac7dbdd2b7 req-e1321592-bb26-435d-8984-52b71a4271d7 tempest-VolumesSnapshotsTestJSON-2107033434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:24 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.info Jul 24 09:42:24 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:24 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89" returned: 0 in 0.469s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:42:24 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a27fc3d-216a-49d8-89c3-dbd67d3e624c]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:24 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-05ee1408-24f1-48ce-b61d-07ac7dbdd2b7 req-e1321592-bb26-435d-8984-52b71a4271d7 tempest-VolumesSnapshotsTestJSON-2107033434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.info" returned: 0 in 0.316s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-05ee1408-24f1-48ce-b61d-07ac7dbdd2b7 req-e1321592-bb26-435d-8984-52b71a4271d7 tempest-VolumesSnapshotsTestJSON-2107033434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.872s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:42:24 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf Jul 24 09:42:24 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:24 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-05ee1408-24f1-48ce-b61d-07ac7dbdd2b7 req-e1321592-bb26-435d-8984-52b71a4271d7 tempest-VolumesSnapshotsTestJSON-2107033434 None] Create snapshot completed successfully Jul 24 09:42:24 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] Acquiring lock "cinder-6f3eca02-c429-415a-9b3e-9e012d9cecc1-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf" returned: 0 in 0.438s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] Lock "cinder-6f3eca02-c429-415a-9b3e-9e012d9cecc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:25 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] Acquiring lock "cinder-quobyte-a96798f0-aee5-4bb5-8daa-c661501e2050" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:25 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] Lock "cinder-quobyte-a96798f0-aee5-4bb5-8daa-c661501e2050" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] Acquiring lock "cinder-quobyte-6f3eca02-c429-415a-9b3e-9e012d9cecc1" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] Lock "cinder-quobyte-6f3eca02-c429-415a-9b3e-9e012d9cecc1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] Deleting offline snapshot 6f3eca02-c429-415a-9b3e-9e012d9cecc1 of volume a96798f0-aee5-4bb5-8daa-c661501e2050 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] snapshot_file for this snap is: volume-a96798f0-aee5-4bb5-8daa-c661501e2050.6f3eca02-c429-415a-9b3e-9e012d9cecc1 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc74f12-750c-4496-b399-67b7a08c956f]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.6f3eca02-c429-415a-9b3e-9e012d9cecc1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:25 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.6f3eca02-c429-415a-9b3e-9e012d9cecc1 Jul 24 09:42:25 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:25 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89" returned: 0 in 0.569s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:25 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89 Jul 24 09:42:25 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:25 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.6f3eca02-c429-415a-9b3e-9e012d9cecc1" returned: 0 in 0.527s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a96798f0-aee5-4bb5-8daa-c661501e2050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7e402d-7ab1-4f71-a17b-fbae4a5318ee]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:25 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050 Jul 24 09:42:25 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:25 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.3760d7b5-d7c8-4e75-b217-89fca88f9a89" returned: 0 in 0.300s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-quobyte-3760d7b5-d7c8-4e75-b217-89fca88f9a89" released by "_delete_snapshot" :: held 1.915s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-quobyte-acd7e7e9-4401-4c1c-ab36-4158b101d57d" released by "delete_snapshot" :: held 1.961s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:25 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] Created reservations ['0a9d4d5b-6a49-4273-b217-3e12efa9ce4e', 'feb44f10-a0cb-41a4-8e79-2dae024a9107', '11a69c9f-ff1a-4e37-9d15-bcfc49ad6b73', '31e8f278-7bb0-442d-a42f-ff2b4be86ee9'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:42:26 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] Delete snapshot completed successfully. Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e043f418-8334-441d-862a-e2fc00721271 tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-3760d7b5-d7c8-4e75-b217-89fca88f9a89-delete_snapshot" released by "delete_snapshot" :: held 2.107s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:26 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] Acquiring lock "cinder-77c76a19-d59f-45bc-9a8d-484da7e256bf-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050" returned: 0 in 0.413s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.6f3eca02-c429-415a-9b3e-9e012d9cecc1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-77c76a19-d59f-45bc-9a8d-484da7e256bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] Acquiring lock "cinder-quobyte-acd7e7e9-4401-4c1c-ab36-4158b101d57d" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:26 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.6f3eca02-c429-415a-9b3e-9e012d9cecc1 Jul 24 09:42:26 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-quobyte-acd7e7e9-4401-4c1c-ab36-4158b101d57d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] Acquiring lock "cinder-quobyte-77c76a19-d59f-45bc-9a8d-484da7e256bf" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-quobyte-77c76a19-d59f-45bc-9a8d-484da7e256bf" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] Deleting offline snapshot 77c76a19-d59f-45bc-9a8d-484da7e256bf of volume acd7e7e9-4401-4c1c-ab36-4158b101d57d {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] snapshot_file for this snap is: volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[19961bb8-fa16-4744-9533-8937ab7dc04d]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:26 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf Jul 24 09:42:26 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:26 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.6f3eca02-c429-415a-9b3e-9e012d9cecc1" returned: 0 in 0.357s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.6f3eca02-c429-415a-9b3e-9e012d9cecc1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:26 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.6f3eca02-c429-415a-9b3e-9e012d9cecc1 Jul 24 09:42:26 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:26 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf" returned: 0 in 0.353s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed056c54-5a5d-48b2-ab2a-fee5132c54d1]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:26 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050.6f3eca02-c429-415a-9b3e-9e012d9cecc1" returned: 0 in 0.260s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:26 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d Jul 24 09:42:26 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] Lock "cinder-quobyte-6f3eca02-c429-415a-9b3e-9e012d9cecc1" released by "_delete_snapshot" :: held 1.693s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] Lock "cinder-quobyte-a96798f0-aee5-4bb5-8daa-c661501e2050" released by "delete_snapshot" :: held 1.728s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG cinder.quota [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] Created reservations ['db90dd4e-152f-4903-9bfe-1b4e46773a7c', 'a79d0bbb-2d03-45e1-8cbc-572b3b64b4f7', '329e39cc-b614-4ac8-8750-962dc4d10b19', '10cc39af-5529-4e57-bb81-9c48b7b49332'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:42:26 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] Delete snapshot completed successfully. Jul 24 09:42:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-5d8b7c68-1dfb-4f12-bcf9-e7aa739a2578 req-f6fdef70-943c-43f0-8c19-c249f7a4931c tempest-VolumesSnapshotsTestJSON-2107033434 None] Lock "cinder-6f3eca02-c429-415a-9b3e-9e012d9cecc1-delete_snapshot" released by "delete_snapshot" :: held 1.908s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:27 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d" returned: 0 in 0.459s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:27 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf Jul 24 09:42:27 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-a1e1db85-533e-4ed7-b19e-7604bb61de91 req-839830ea-5906-416e-b266-66e80c2f1d71 tempest-VolumesSnapshotsTestJSON-2107033434 None] Acquiring lock "cinder-a96798f0-aee5-4bb5-8daa-c661501e2050-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-a1e1db85-533e-4ed7-b19e-7604bb61de91 req-839830ea-5906-416e-b266-66e80c2f1d71 tempest-VolumesSnapshotsTestJSON-2107033434 None] Lock "cinder-a96798f0-aee5-4bb5-8daa-c661501e2050-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-a1e1db85-533e-4ed7-b19e-7604bb61de91 req-839830ea-5906-416e-b266-66e80c2f1d71 tempest-VolumesSnapshotsTestJSON-2107033434 None] Acquiring lock "cinder-quobyte-a96798f0-aee5-4bb5-8daa-c661501e2050" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-a1e1db85-533e-4ed7-b19e-7604bb61de91 req-839830ea-5906-416e-b266-66e80c2f1d71 tempest-VolumesSnapshotsTestJSON-2107033434 None] Lock "cinder-quobyte-a96798f0-aee5-4bb5-8daa-c661501e2050" acquired by "delete_volume" :: waited 0.033s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:27 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fc1b10-5137-477d-b0bd-01826254283b]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-a1e1db85-533e-4ed7-b19e-7604bb61de91 req-839830ea-5906-416e-b266-66e80c2f1d71 tempest-VolumesSnapshotsTestJSON-2107033434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:27 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf" returned: 0 in 0.500s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:27 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf Jul 24 09:42:27 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:27 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050 Jul 24 09:42:27 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:27 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d.77c76a19-d59f-45bc-9a8d-484da7e256bf" returned: 0 in 0.327s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-quobyte-77c76a19-d59f-45bc-9a8d-484da7e256bf" released by "_delete_snapshot" :: held 1.763s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-quobyte-acd7e7e9-4401-4c1c-ab36-4158b101d57d" released by "delete_snapshot" :: held 1.787s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] Created reservations ['99a4d0b0-5dee-4528-b32a-53554d98a051', '9a853a83-ee2a-4e72-bf3a-cf76579889e8', '1dc7734d-0e4f-4f81-a42c-19c82a44eac0', '1f4294c3-1b58-4783-907f-e5f0ae8c0ef4'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:42:28 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] Delete snapshot completed successfully. Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-72836c4c-a513-41ef-89fd-3f73db37c80a tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-77c76a19-d59f-45bc-9a8d-484da7e256bf-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:28 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-a1e1db85-533e-4ed7-b19e-7604bb61de91 req-839830ea-5906-416e-b266-66e80c2f1d71 tempest-VolumesSnapshotsTestJSON-2107033434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050" returned: 0 in 0.545s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-a1e1db85-533e-4ed7-b19e-7604bb61de91 req-839830ea-5906-416e-b266-66e80c2f1d71 tempest-VolumesSnapshotsTestJSON-2107033434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:28 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050 Jul 24 09:42:28 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:28 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-a1e1db85-533e-4ed7-b19e-7604bb61de91 req-839830ea-5906-416e-b266-66e80c2f1d71 tempest-VolumesSnapshotsTestJSON-2107033434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a96798f0-aee5-4bb5-8daa-c661501e2050" returned: 0 in 0.264s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-29fe80cc-c16b-4c78-9e4e-318d44c750cf tempest-VolumesSnapshotListTestJSON-1039835064 None] Acquiring lock "cinder-acd7e7e9-4401-4c1c-ab36-4158b101d57d-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-a1e1db85-533e-4ed7-b19e-7604bb61de91 req-839830ea-5906-416e-b266-66e80c2f1d71 tempest-VolumesSnapshotsTestJSON-2107033434 None] Lock "cinder-quobyte-a96798f0-aee5-4bb5-8daa-c661501e2050" released by "delete_volume" :: held 0.917s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-29fe80cc-c16b-4c78-9e4e-318d44c750cf tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-acd7e7e9-4401-4c1c-ab36-4158b101d57d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-29fe80cc-c16b-4c78-9e4e-318d44c750cf tempest-VolumesSnapshotListTestJSON-1039835064 None] Acquiring lock "cinder-quobyte-acd7e7e9-4401-4c1c-ab36-4158b101d57d" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG cinder.quota [req-a1e1db85-533e-4ed7-b19e-7604bb61de91 req-839830ea-5906-416e-b266-66e80c2f1d71 tempest-VolumesSnapshotsTestJSON-2107033434 None] Created reservations ['1ee24359-1ceb-4fa6-8d5d-494a78254a5c', '5c89e799-d09c-45f6-b134-670cfb90dcfa', '8a1c3553-59f5-456f-976c-8590a8a5fb36', '1ba2901a-e210-49b8-939a-8028346121a1'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-29fe80cc-c16b-4c78-9e4e-318d44c750cf tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-quobyte-acd7e7e9-4401-4c1c-ab36-4158b101d57d" acquired by "delete_volume" :: waited 0.032s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf4a519-9be3-4276-af8d-b4b90e65ecde]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-29fe80cc-c16b-4c78-9e4e-318d44c750cf tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-a1e1db85-533e-4ed7-b19e-7604bb61de91 req-839830ea-5906-416e-b266-66e80c2f1d71 tempest-VolumesSnapshotsTestJSON-2107033434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-a1e1db85-533e-4ed7-b19e-7604bb61de91 req-839830ea-5906-416e-b266-66e80c2f1d71 tempest-VolumesSnapshotsTestJSON-2107033434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [req-a1e1db85-533e-4ed7-b19e-7604bb61de91 req-839830ea-5906-416e-b266-66e80c2f1d71 tempest-VolumesSnapshotsTestJSON-2107033434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [req-a1e1db85-533e-4ed7-b19e-7604bb61de91 req-839830ea-5906-416e-b266-66e80c2f1d71 tempest-VolumesSnapshotsTestJSON-2107033434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-a1e1db85-533e-4ed7-b19e-7604bb61de91 req-839830ea-5906-416e-b266-66e80c2f1d71 tempest-VolumesSnapshotsTestJSON-2107033434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-a1e1db85-533e-4ed7-b19e-7604bb61de91 req-839830ea-5906-416e-b266-66e80c2f1d71 tempest-VolumesSnapshotsTestJSON-2107033434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:28 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:42:28 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:28 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d Jul 24 09:42:28 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:28 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-a1e1db85-533e-4ed7-b19e-7604bb61de91 req-839830ea-5906-416e-b266-66e80c2f1d71 tempest-VolumesSnapshotsTestJSON-2107033434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.355s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:28 devstack cinder-volume[88488]: DEBUG cinder.manager [req-a1e1db85-533e-4ed7-b19e-7604bb61de91 req-839830ea-5906-416e-b266-66e80c2f1d71 tempest-VolumesSnapshotsTestJSON-2107033434 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:42:28 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-a1e1db85-533e-4ed7-b19e-7604bb61de91 req-839830ea-5906-416e-b266-66e80c2f1d71 tempest-VolumesSnapshotsTestJSON-2107033434 None] Deleted volume successfully. Jul 24 09:42:29 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-a1e1db85-533e-4ed7-b19e-7604bb61de91 req-839830ea-5906-416e-b266-66e80c2f1d71 tempest-VolumesSnapshotsTestJSON-2107033434 None] Lock "cinder-a96798f0-aee5-4bb5-8daa-c661501e2050-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:29 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-29fe80cc-c16b-4c78-9e4e-318d44c750cf tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d" returned: 0 in 0.499s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-29fe80cc-c16b-4c78-9e4e-318d44c750cf tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:29 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d Jul 24 09:42:29 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:29 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-29fe80cc-c16b-4c78-9e4e-318d44c750cf tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-acd7e7e9-4401-4c1c-ab36-4158b101d57d" returned: 0 in 0.324s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:29 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-29fe80cc-c16b-4c78-9e4e-318d44c750cf tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-quobyte-acd7e7e9-4401-4c1c-ab36-4158b101d57d" released by "delete_volume" :: held 0.899s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:29 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-29fe80cc-c16b-4c78-9e4e-318d44c750cf tempest-VolumesSnapshotListTestJSON-1039835064 None] Created reservations ['749d1818-f687-4a1d-b0f0-465d0ef19a09', '8113982c-bd49-47c3-a865-ef4aa9bc79a1', 'b4255af5-2c69-44ad-9cd4-6d6643bb6f94', 'c0e2b90c-29fb-42df-b66b-a86691b5120d'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:42:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-29fe80cc-c16b-4c78-9e4e-318d44c750cf tempest-VolumesSnapshotListTestJSON-1039835064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:42:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-29fe80cc-c16b-4c78-9e4e-318d44c750cf tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:42:29 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-29fe80cc-c16b-4c78-9e4e-318d44c750cf tempest-VolumesSnapshotListTestJSON-1039835064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:42:29 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-29fe80cc-c16b-4c78-9e4e-318d44c750cf tempest-VolumesSnapshotListTestJSON-1039835064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:42:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-29fe80cc-c16b-4c78-9e4e-318d44c750cf tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:42:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-29fe80cc-c16b-4c78-9e4e-318d44c750cf tempest-VolumesSnapshotListTestJSON-1039835064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:29 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:42:29 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:29 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-29fe80cc-c16b-4c78-9e4e-318d44c750cf tempest-VolumesSnapshotListTestJSON-1039835064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.310s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:29 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-29fe80cc-c16b-4c78-9e4e-318d44c750cf tempest-VolumesSnapshotListTestJSON-1039835064 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:42:29 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-29fe80cc-c16b-4c78-9e4e-318d44c750cf tempest-VolumesSnapshotListTestJSON-1039835064 None] Deleted volume successfully. Jul 24 09:42:29 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-29fe80cc-c16b-4c78-9e4e-318d44c750cf tempest-VolumesSnapshotListTestJSON-1039835064 None] Lock "cinder-acd7e7e9-4401-4c1c-ab36-4158b101d57d-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:39 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=157,cinder:UPDATE=167,cinder:INSERT=46,cinder:DELETE=8 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:42:39 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-3fefa378-a220-4805-ae36-d3a977cad5e6 tempest-GroupsV314Test-1737928013 None] Group tempest-GroupsV314Test-Group-1184640675: creating Jul 24 09:42:39 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=175,cinder:DELETE=13,cinder:SELECT=151,cinder:INSERT=39 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:42:39 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-3fefa378-a220-4805-ae36-d3a977cad5e6 tempest-GroupsV314Test-1737928013 None] Group tempest-GroupsV314Test-Group-1184640675: created successfully Jul 24 09:42:39 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-3fefa378-a220-4805-ae36-d3a977cad5e6 tempest-GroupsV314Test-1737928013 None] Create group completed successfully. Jul 24 09:42:40 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:42:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Flow 'volume_create_manager' (284eec73-5d22-4a72-b03c-88d5c1ec3024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb224d8-3585-4942-88d8-f97adabca53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb224d8-3585-4942-88d8-f97adabca53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1168814609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3895c763-eee2-460d-826d-1d9d25422b68,host='devstack@QuobyteHD#QuobyteHD',id=58e0cad4-a548-417b-94f5-c7717c49776b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f7d6bf9ed148239f246dcc42430da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:42:41Z,use_quota=True,user_id='17d2bf080ab149b5bc31f053fe5321cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24aa2d1d-d45e-4640-82af-5f81da13b8cb),volume_type_id=24aa2d1d-d45e-4640-82af-5f81da13b8cb)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97425668-b370-48b0-ba46-d52407cd67a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97425668-b370-48b0-ba46-d52407cd67a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563970a3-d6d6-4262-8f6f-d0a68dfd0163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563970a3-d6d6-4262-8f6f-d0a68dfd0163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58e0cad4-a548-417b-94f5-c7717c49776b', 'volume_name': 'volume-58e0cad4-a548-417b-94f5-c7717c49776b', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229a70d8-6219-42c5-a45d-6af84df36e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229a70d8-6219-42c5-a45d-6af84df36e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d553c55-a53c-434a-aa30-b16dc6ee0c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:41 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Volume 58e0cad4-a548-417b-94f5-c7717c49776b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58e0cad4-a548-417b-94f5-c7717c49776b', 'volume_size': 1} Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3895c763-eee2-460d-826d-1d9d25422b68,created_at=2026-07-24T07:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1168814609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3895c763-eee2-460d-826d-1d9d25422b68,host='devstack@QuobyteHD#QuobyteHD',id=58e0cad4-a548-417b-94f5-c7717c49776b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f7d6bf9ed148239f246dcc42430da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:42:41Z,use_quota=True,user_id='17d2bf080ab149b5bc31f053fe5321cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24aa2d1d-d45e-4640-82af-5f81da13b8cb),volume_type_id=24aa2d1d-d45e-4640-82af-5f81da13b8cb)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Creating volume 58e0cad4-a548-417b-94f5-c7717c49776b {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:42:41 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:41 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b 1073741824 Jul 24 09:42:41 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:41 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b 1073741824" returned: 0 in 0.616s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:41 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b Jul 24 09:42:41 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:42 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b" returned: 0 in 0.403s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:42 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:42:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:42:42 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d553c55-a53c-434a-aa30-b16dc6ee0c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58e0cad4-a548-417b-94f5-c7717c49776b', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:42 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d202fb87-f4bb-4b16-90e1-305185ecc89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:42 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Volume volume-58e0cad4-a548-417b-94f5-c7717c49776b (58e0cad4-a548-417b-94f5-c7717c49776b): created successfully Jul 24 09:42:42 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d202fb87-f4bb-4b16-90e1-305185ecc89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:42 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Flow 'volume_create_manager' (284eec73-5d22-4a72-b03c-88d5c1ec3024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:42:42 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-f2f659b1-fbe9-4a4d-9e7d-7cc234856b3c tempest-GroupsV314Test-1737928013 None] Created volume successfully. Jul 24 09:42:43 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:42:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Flow 'volume_create_manager' (0ba64a90-1d41-4973-8026-1aecea589da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:42:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b598d8-d979-41b1-b641-bd65ba490ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b598d8-d979-41b1-b641-bd65ba490ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-794062663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b752163e-2cc1-4256-b498-027060cebff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88b868591a4a44a8a54919f446eca4f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:42:43Z,use_quota=True,user_id='aeb98fa071864f0aa96197ed110777d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25688f05-68ab-4b66-82cb-99da29820167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25688f05-68ab-4b66-82cb-99da29820167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173547c7-18aa-4938-af14-6172a360c24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:43 devstack cinder-volume[88488]: DEBUG cinder.image.glance [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Creating Keystone auth plugin from conf {{(pid=88488) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 09:42:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173547c7-18aa-4938-af14-6172a360c24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b752163e-2cc1-4256-b498-027060cebff5', 'volume_name': 'volume-b752163e-2cc1-4256-b498-027060cebff5', 'volume_size': 1, 'image_id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3181d69d4e349c08df0ab05faa1a57c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'created_at': datetime.datetime(2026, 7, 24, 7, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d877dfea-234d-41dc-9354-b61147b7273a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d877dfea-234d-41dc-9354-b61147b7273a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:42:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c0c0cd-28a8-42f3-8546-fe362192421d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:42:44 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Volume b752163e-2cc1-4256-b498-027060cebff5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b752163e-2cc1-4256-b498-027060cebff5', 'volume_size': 1, 'image_id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3181d69d4e349c08df0ab05faa1a57c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'created_at': datetime.datetime(2026, 7, 24, 7, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 24 09:42:44 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Trying to clone b752163e-2cc1-4256-b498-027060cebff5 from image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc at location (None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}]). {{(pid=88488) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 09:42:44 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_g2c3g45udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 09:42:44 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Image download 20.69 MB at 20.69 MB/s Jul 24 09:42:44 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e4e8ca-41ec-40ef-996d-b91b75ae9b9f]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_g2c3g45udevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:42:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:42:44 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Cloning volume 58e0cad4-a548-417b-94f5-c7717c49776b to volume 9ceaed7a-a3a3-4919-9ab4-6c268319191d Jul 24 09:42:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Creating offline snapshot c7080ccc-8f04-4d08-b247-641d500582a5 of volume 58e0cad4-a548-417b-94f5-c7717c49776b {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:42:44 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fb85f9-6228-422d-bf79-78f5fe5da3e1]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:45 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_g2c3g45udevstack@QuobyteHD Jul 24 09:42:45 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:45 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b Jul 24 09:42:45 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:45 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_g2c3g45udevstack@QuobyteHD" returned: 0 in 0.661s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:45 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Temporary image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc is fetched for user aeb98fa071864f0aa96197ed110777d9. {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 09:42:45 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b" returned: 0 in 0.564s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:45 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5 1G Jul 24 09:42:45 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:45 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b852f1d6-5e50-4a84-aa6c-f08f37794464]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_g2c3g45udevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:45 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_g2c3g45udevstack@QuobyteHD Jul 24 09:42:45 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:46 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_g2c3g45udevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:42:46 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5 1G" returned: 0 in 0.563s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58e0cad4-a548-417b-94f5-c7717c49776b -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:46 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58e0cad4-a548-417b-94f5-c7717c49776b -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5 Jul 24 09:42:46 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:46 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58e0cad4-a548-417b-94f5-c7717c49776b -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5" returned: 0 in 0.343s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:46 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5 is being set with open permissions: ugo+rw: NotImplementedError Jul 24 09:42:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:46 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5 Jul 24 09:42:46 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:46 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5" returned: 0 in 0.347s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:46 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.info Jul 24 09:42:46 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:47 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.info" returned: 0 in 0.291s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:47 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 09:42:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:47 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.info Jul 24 09:42:47 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:47 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.info" returned: 0 in 0.312s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Acquiring lock "cinder-quobyte-9ceaed7a-a3a3-4919-9ab4-6c268319191d" by "_copy_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Lock "cinder-quobyte-9ceaed7a-a3a3-4919-9ab4-6c268319191d" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] snapshot: c7080ccc-8f04-4d08-b247-641d500582a5, volume: 9ceaed7a-a3a3-4919-9ab4-6c268319191d, {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 09:42:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:42:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:42:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:42:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:42:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:42:47 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1b356b-2d8a-457e-a3a5-5bff027402b0]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:47 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5 Jul 24 09:42:47 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:47 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5" returned: 0 in 0.402s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58e0cad4-a548-417b-94f5-c7717c49776b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:42:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 09:42:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Creating direct copy from snapshot {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 09:42:47 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30283a3-6032-441f-8b1c-818bfe7daadf]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:48 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b Jul 24 09:42:48 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:48 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b" returned: 0 in 0.435s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:48 devstack cinder-volume[88488]: DEBUG cinder.utils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Path /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9ceaed7a-a3a3-4919-9ab4-6c268319191d not found in is_blk_device check {{(pid=88488) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 09:42:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9ceaed7a-a3a3-4919-9ab4-6c268319191d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:48 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9ceaed7a-a3a3-4919-9ab4-6c268319191d Jul 24 09:42:48 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:53 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9ceaed7a-a3a3-4919-9ab4-6c268319191d" returned: 0 in 5.622s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:54 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[258dae63-e037-4862-ba9b-4a9d8d5755ef]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:54 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b Jul 24 09:42:54 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:54 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b" returned: 0 in 0.556s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:54 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9ceaed7a-a3a3-4919-9ab4-6c268319191d {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:42:54 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Converted 1024.00 MB image at 182.04 MB/s Jul 24 09:42:54 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9ceaed7a-a3a3-4919-9ab4-6c268319191d is being set with open permissions: ugo+rw: NotImplementedError Jul 24 09:42:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9ceaed7a-a3a3-4919-9ab4-6c268319191d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:54 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9ceaed7a-a3a3-4919-9ab4-6c268319191d Jul 24 09:42:54 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:54 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9ceaed7a-a3a3-4919-9ab4-6c268319191d" returned: 0 in 0.278s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Lock "cinder-quobyte-9ceaed7a-a3a3-4919-9ab4-6c268319191d" released by "_copy_volume_from_snapshot" :: held 7.388s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Acquiring lock "cinder-quobyte-c7080ccc-8f04-4d08-b247-641d500582a5" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Lock "cinder-quobyte-c7080ccc-8f04-4d08-b247-641d500582a5" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Deleting offline snapshot c7080ccc-8f04-4d08-b247-641d500582a5 of volume 58e0cad4-a548-417b-94f5-c7717c49776b {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:42:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] snapshot_file for this snap is: volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:42:54 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a344e40b-164d-435e-ad8d-f4ad7059bc86]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:55 devstack sudo[96779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5 Jul 24 09:42:55 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:55 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5" returned: 0 in 0.399s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58e0cad4-a548-417b-94f5-c7717c49776b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:42:55 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[725a71f9-7776-4f26-855c-470c7de5839b]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:55 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b Jul 24 09:42:55 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:55 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b" returned: 0 in 0.429s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:55 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5 Jul 24 09:42:55 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:56 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5" returned: 0 in 0.532s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:56 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5 Jul 24 09:42:56 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:56 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b.c7080ccc-8f04-4d08-b247-641d500582a5" returned: 0 in 0.372s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Lock "cinder-quobyte-c7080ccc-8f04-4d08-b247-641d500582a5" released by "_delete_snapshot" :: held 1.887s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:42:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.952s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:42:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.825s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:42:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-794062663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b752163e-2cc1-4256-b498-027060cebff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88b868591a4a44a8a54919f446eca4f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:42:43Z,use_quota=True,user_id='aeb98fa071864f0aa96197ed110777d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:42:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Creating volume b752163e-2cc1-4256-b498-027060cebff5 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:42:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:42:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:42:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:42:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:42:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:42:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:42:56 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:42:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b752163e-2cc1-4256-b498-027060cebff5 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:56 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b752163e-2cc1-4256-b498-027060cebff5 1073741824 Jul 24 09:42:56 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:57 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-4286cebc-4ffe-40d7-85da-741d6356c2a2 tempest-GroupsV314Test-1737928013 None] Create group from source-group-3895c763-eee2-460d-826d-1d9d25422b68 completed successfully. Jul 24 09:42:57 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b752163e-2cc1-4256-b498-027060cebff5 1073741824" returned: 0 in 0.727s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b752163e-2cc1-4256-b498-027060cebff5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:57 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b752163e-2cc1-4256-b498-027060cebff5 Jul 24 09:42:57 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:57 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b752163e-2cc1-4256-b498-027060cebff5" returned: 0 in 0.286s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:57 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:42:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:42:57 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Attempting download of ce0135c3-cdf3-4327-98f4-fcc81dc66bbc ((None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}])) to volume b752163e-2cc1-4256-b498-027060cebff5. {{(pid=88488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 09:42:57 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b0ed16-991b-4292-948c-c51f6469fee4]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_r99r9ta7 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:58 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_r99r9ta7 Jul 24 09:42:58 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:58 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_r99r9ta7" returned: 0 in 0.427s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_r99r9ta7 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:58 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_r99r9ta7 Jul 24 09:42:58 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:58 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_r99r9ta7" returned: 1 in 0.391s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_r99r9ta7' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:42:58 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b151e50-d6bb-47a1-b8d0-d67c021638d0]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_g2c3g45udevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-612b69fb-c9fd-47c9-ba48-b05307138879 tempest-GroupsV314Test-1737928013 None] Acquiring lock "cinder-quobyte-9ceaed7a-a3a3-4919-9ab4-6c268319191d" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:42:58 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_g2c3g45udevstack@QuobyteHD Jul 24 09:42:58 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-612b69fb-c9fd-47c9-ba48-b05307138879 tempest-GroupsV314Test-1737928013 None] Lock "cinder-quobyte-9ceaed7a-a3a3-4919-9ab4-6c268319191d" acquired by "delete_volume" :: waited 0.038s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:42:59 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4429d3c2-48bd-446a-ba73-8c42cb270a9e]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:42:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-612b69fb-c9fd-47c9-ba48-b05307138879 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9ceaed7a-a3a3-4919-9ab4-6c268319191d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:59 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9ceaed7a-a3a3-4919-9ab4-6c268319191d Jul 24 09:42:59 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:59 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_g2c3g45udevstack@QuobyteHD" returned: 0 in 0.543s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:59 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] ce0135c3-cdf3-4327-98f4-fcc81dc66bbc was qcow2, converting to qcow2 {{(pid=88488) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 09:42:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_g2c3g45udevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b752163e-2cc1-4256-b498-027060cebff5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:59 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_g2c3g45udevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b752163e-2cc1-4256-b498-027060cebff5 Jul 24 09:42:59 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:42:59 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Jul 24 09:42:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-612b69fb-c9fd-47c9-ba48-b05307138879 tempest-GroupsV314Test-1737928013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9ceaed7a-a3a3-4919-9ab4-6c268319191d" returned: 0 in 0.679s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:42:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-612b69fb-c9fd-47c9-ba48-b05307138879 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9ceaed7a-a3a3-4919-9ab4-6c268319191d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:42:59 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9ceaed7a-a3a3-4919-9ab4-6c268319191d Jul 24 09:42:59 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:00 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-612b69fb-c9fd-47c9-ba48-b05307138879 tempest-GroupsV314Test-1737928013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9ceaed7a-a3a3-4919-9ab4-6c268319191d" returned: 0 in 0.479s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-612b69fb-c9fd-47c9-ba48-b05307138879 tempest-GroupsV314Test-1737928013 None] Lock "cinder-quobyte-9ceaed7a-a3a3-4919-9ab4-6c268319191d" released by "delete_volume" :: held 1.242s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:43:00 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-612b69fb-c9fd-47c9-ba48-b05307138879 tempest-GroupsV314Test-1737928013 None] Created reservations ['4de21b0b-d3d3-42aa-8fbc-43657209c129'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:43:00 devstack cinder-volume[88488]: WARNING cinder.quota [None req-612b69fb-c9fd-47c9-ba48-b05307138879 tempest-GroupsV314Test-1737928013 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1874668446 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1874668446, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:43:00 devstack cinder-volume[88488]: WARNING cinder.quota [None req-612b69fb-c9fd-47c9-ba48-b05307138879 tempest-GroupsV314Test-1737928013 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1874668446 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1874668446, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:43:00 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-612b69fb-c9fd-47c9-ba48-b05307138879 tempest-GroupsV314Test-1737928013 None] Created reservations ['1ddaf4a3-3b37-4a76-ac31-d4f35eb1dd1e', 'c606118b-594b-4ee1-9174-44767f6e3827', '59fd3bd2-7e31-4bee-a82a-4f045ab88fe6', 'ecc5243f-c2b5-4dad-9787-7cbb0bfd5508'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:43:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-612b69fb-c9fd-47c9-ba48-b05307138879 tempest-GroupsV314Test-1737928013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-612b69fb-c9fd-47c9-ba48-b05307138879 tempest-GroupsV314Test-1737928013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-612b69fb-c9fd-47c9-ba48-b05307138879 tempest-GroupsV314Test-1737928013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-612b69fb-c9fd-47c9-ba48-b05307138879 tempest-GroupsV314Test-1737928013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-612b69fb-c9fd-47c9-ba48-b05307138879 tempest-GroupsV314Test-1737928013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-612b69fb-c9fd-47c9-ba48-b05307138879 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:00 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:43:00 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:01 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-612b69fb-c9fd-47c9-ba48-b05307138879 tempest-GroupsV314Test-1737928013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.400s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:01 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-612b69fb-c9fd-47c9-ba48-b05307138879 tempest-GroupsV314Test-1737928013 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:43:01 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-612b69fb-c9fd-47c9-ba48-b05307138879 tempest-GroupsV314Test-1737928013 None] Delete group completed successfully. Jul 24 09:43:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9ebbb350-8de7-42f2-b216-2f3842c4d0b3 tempest-GroupsV314Test-1737928013 None] Acquiring lock "cinder-quobyte-58e0cad4-a548-417b-94f5-c7717c49776b" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:43:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9ebbb350-8de7-42f2-b216-2f3842c4d0b3 tempest-GroupsV314Test-1737928013 None] Lock "cinder-quobyte-58e0cad4-a548-417b-94f5-c7717c49776b" acquired by "delete_volume" :: waited 0.032s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:43:01 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4690ef-407f-464b-8e5d-57a9163317db]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:43:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9ebbb350-8de7-42f2-b216-2f3842c4d0b3 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:02 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b Jul 24 09:43:02 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:02 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_g2c3g45udevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b752163e-2cc1-4256-b498-027060cebff5" returned: 0 in 3.138s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:02 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_g2c3g45udevstack@QuobyteHD, size 112.00 MB, duration 3.14 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b752163e-2cc1-4256-b498-027060cebff5 {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:43:02 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Converted 112.00 MB image at 35.68 MB/s Jul 24 09:43:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b752163e-2cc1-4256-b498-027060cebff5 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:02 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b752163e-2cc1-4256-b498-027060cebff5 1G Jul 24 09:43:02 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:02 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9ebbb350-8de7-42f2-b216-2f3842c4d0b3 tempest-GroupsV314Test-1737928013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b" returned: 0 in 0.649s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9ebbb350-8de7-42f2-b216-2f3842c4d0b3 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:02 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b Jul 24 09:43:02 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:03 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:03 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9ebbb350-8de7-42f2-b216-2f3842c4d0b3 tempest-GroupsV314Test-1737928013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-58e0cad4-a548-417b-94f5-c7717c49776b" returned: 0 in 0.484s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b752163e-2cc1-4256-b498-027060cebff5 1G" returned: 0 in 0.585s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Downloaded image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc ((None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}])) to volume b752163e-2cc1-4256-b498-027060cebff5 successfully. {{(pid=88488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Temporary image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc for user aeb98fa071864f0aa96197ed110777d9 is deleted. {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Marking volume b752163e-2cc1-4256-b498-027060cebff5 as bootable. {{(pid=88488) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9ebbb350-8de7-42f2-b216-2f3842c4d0b3 tempest-GroupsV314Test-1737928013 None] Lock "cinder-quobyte-58e0cad4-a548-417b-94f5-c7717c49776b" released by "delete_volume" :: held 1.241s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Copying metadata from image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc to b752163e-2cc1-4256-b498-027060cebff5. {{(pid=88488) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Creating volume glance metadata for volume b752163e-2cc1-4256-b498-027060cebff5 backed by image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88488) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-9ebbb350-8de7-42f2-b216-2f3842c4d0b3 tempest-GroupsV314Test-1737928013 None] Created reservations ['da52c783-4cea-46c4-a49d-4fe53ca3788f'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-9ebbb350-8de7-42f2-b216-2f3842c4d0b3 tempest-GroupsV314Test-1737928013 None] Created reservations ['680157bc-2e5a-43cd-ba5b-ebcc2928f096', '991ec20d-3aac-490c-9acc-98a21c34f588', '2f048e5d-5839-461a-a971-c9289359f79c', '47623110-8618-4715-9f6c-a160c7cfb827'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c0c0cd-28a8-42f3-8546-fe362192421d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b752163e-2cc1-4256-b498-027060cebff5', 'volume_size': 1, 'image_id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3181d69d4e349c08df0ab05faa1a57c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'created_at': datetime.datetime(2026, 7, 24, 7, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34aa2a67-bcfe-4308-b13b-9ff06a6b3f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:03 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Volume volume-b752163e-2cc1-4256-b498-027060cebff5 (b752163e-2cc1-4256-b498-027060cebff5): created successfully Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34aa2a67-bcfe-4308-b13b-9ff06a6b3f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Flow 'volume_create_manager' (0ba64a90-1d41-4973-8026-1aecea589da1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:03 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-6fbb4dba-4034-449c-8659-601a5708f4e6 tempest-VolumesImageMetadata-141634171 None] Created volume successfully. Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9ebbb350-8de7-42f2-b216-2f3842c4d0b3 tempest-GroupsV314Test-1737928013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9ebbb350-8de7-42f2-b216-2f3842c4d0b3 tempest-GroupsV314Test-1737928013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9ebbb350-8de7-42f2-b216-2f3842c4d0b3 tempest-GroupsV314Test-1737928013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9ebbb350-8de7-42f2-b216-2f3842c4d0b3 tempest-GroupsV314Test-1737928013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9ebbb350-8de7-42f2-b216-2f3842c4d0b3 tempest-GroupsV314Test-1737928013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9ebbb350-8de7-42f2-b216-2f3842c4d0b3 tempest-GroupsV314Test-1737928013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:03 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:43:03 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:03 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9ebbb350-8de7-42f2-b216-2f3842c4d0b3 tempest-GroupsV314Test-1737928013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.401s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:03 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-9ebbb350-8de7-42f2-b216-2f3842c4d0b3 tempest-GroupsV314Test-1737928013 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:43:03 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-9ebbb350-8de7-42f2-b216-2f3842c4d0b3 tempest-GroupsV314Test-1737928013 None] Delete group completed successfully. Jul 24 09:43:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b9161832-757c-4034-a27a-d08daeffa0fa tempest-VolumesImageMetadata-141634171 None] Acquiring lock "cinder-b752163e-2cc1-4256-b498-027060cebff5-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:43:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b9161832-757c-4034-a27a-d08daeffa0fa tempest-VolumesImageMetadata-141634171 None] Lock "cinder-b752163e-2cc1-4256-b498-027060cebff5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:43:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b9161832-757c-4034-a27a-d08daeffa0fa tempest-VolumesImageMetadata-141634171 None] Acquiring lock "cinder-quobyte-b752163e-2cc1-4256-b498-027060cebff5" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:43:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b9161832-757c-4034-a27a-d08daeffa0fa tempest-VolumesImageMetadata-141634171 None] Lock "cinder-quobyte-b752163e-2cc1-4256-b498-027060cebff5" acquired by "delete_volume" :: waited 0.033s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:43:05 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2031d91-038e-4d8f-b502-8261db493e69]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:43:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b9161832-757c-4034-a27a-d08daeffa0fa tempest-VolumesImageMetadata-141634171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b752163e-2cc1-4256-b498-027060cebff5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:05 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b752163e-2cc1-4256-b498-027060cebff5 Jul 24 09:43:05 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:05 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b9161832-757c-4034-a27a-d08daeffa0fa tempest-VolumesImageMetadata-141634171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b752163e-2cc1-4256-b498-027060cebff5" returned: 0 in 0.631s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b9161832-757c-4034-a27a-d08daeffa0fa tempest-VolumesImageMetadata-141634171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b752163e-2cc1-4256-b498-027060cebff5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:06 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b752163e-2cc1-4256-b498-027060cebff5 Jul 24 09:43:06 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:06 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b9161832-757c-4034-a27a-d08daeffa0fa tempest-VolumesImageMetadata-141634171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b752163e-2cc1-4256-b498-027060cebff5" returned: 0 in 0.365s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b9161832-757c-4034-a27a-d08daeffa0fa tempest-VolumesImageMetadata-141634171 None] Lock "cinder-quobyte-b752163e-2cc1-4256-b498-027060cebff5" released by "delete_volume" :: held 1.072s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:43:06 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-b9161832-757c-4034-a27a-d08daeffa0fa tempest-VolumesImageMetadata-141634171 None] Created reservations ['840e3745-70bd-49c7-b77e-5e54d24afa90', '79dad15b-bf98-4746-ad16-51e4e6ccd5b0', 'f0611d07-17ac-45d8-b574-7fb15de3dab5', 'b87e7af8-8e5e-4410-9ed0-2751f7e88995'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:43:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b9161832-757c-4034-a27a-d08daeffa0fa tempest-VolumesImageMetadata-141634171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b9161832-757c-4034-a27a-d08daeffa0fa tempest-VolumesImageMetadata-141634171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b9161832-757c-4034-a27a-d08daeffa0fa tempest-VolumesImageMetadata-141634171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b9161832-757c-4034-a27a-d08daeffa0fa tempest-VolumesImageMetadata-141634171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b9161832-757c-4034-a27a-d08daeffa0fa tempest-VolumesImageMetadata-141634171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b9161832-757c-4034-a27a-d08daeffa0fa tempest-VolumesImageMetadata-141634171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:06 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:43:06 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:06 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b9161832-757c-4034-a27a-d08daeffa0fa tempest-VolumesImageMetadata-141634171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.352s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:06 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-b9161832-757c-4034-a27a-d08daeffa0fa tempest-VolumesImageMetadata-141634171 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:43:06 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b9161832-757c-4034-a27a-d08daeffa0fa tempest-VolumesImageMetadata-141634171 None] Deleted volume successfully. Jul 24 09:43:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b9161832-757c-4034-a27a-d08daeffa0fa tempest-VolumesImageMetadata-141634171 None] Lock "cinder-b752163e-2cc1-4256-b498-027060cebff5-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:43:13 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:43:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Flow 'volume_create_manager' (f6591334-844f-49bb-b417-12e8983649ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6fedc0-70a2-4fab-84cf-28af0991e29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:13 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:43:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Flow 'volume_create_manager' (60eb0849-82a8-49e0-9038-a5e93447a39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2071c7ea-ab6b-47a0-afb0-da50ad9a51ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6fedc0-70a2-4fab-84cf-28af0991e29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1513483324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3226a18-a84f-4d4a-abe2-af31262640b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19cc50963eb4347813dc6be9b354129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:14Z,use_quota=True,user_id='bd5a28dbed75423d90835e25fb27950b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2d4603-0100-47e7-9771-5e21ccf96183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2d4603-0100-47e7-9771-5e21ccf96183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df27321-3ca9-4f80-8daa-20fe45217c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df27321-3ca9-4f80-8daa-20fe45217c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3226a18-a84f-4d4a-abe2-af31262640b1', 'volume_name': 'volume-f3226a18-a84f-4d4a-abe2-af31262640b1', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f24f707-9e19-45b2-90d3-204e13e0e6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f24f707-9e19-45b2-90d3-204e13e0e6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e9773a-d8ad-4613-bfca-051680fe1633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:14 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Volume f3226a18-a84f-4d4a-abe2-af31262640b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3226a18-a84f-4d4a-abe2-af31262640b1', 'volume_size': 1} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1513483324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3226a18-a84f-4d4a-abe2-af31262640b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19cc50963eb4347813dc6be9b354129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:14Z,use_quota=True,user_id='bd5a28dbed75423d90835e25fb27950b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Creating volume f3226a18-a84f-4d4a-abe2-af31262640b1 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:43:14 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f3226a18-a84f-4d4a-abe2-af31262640b1 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2071c7ea-ab6b-47a0-afb0-da50ad9a51ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2096516175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fbf4f5-bcc8-4def-bf67-918fa6759b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c493a9679842d6bb6ef49d13891dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:14Z,use_quota=True,user_id='240ea39ed04d48fdafffda04e386cf62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd811303-7d68-408f-9891-057e7a23308a),volume_type_id=fd811303-7d68-408f-9891-057e7a23308a)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af75f59b-1776-4cf4-8bf6-e15ce9e4641b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af75f59b-1776-4cf4-8bf6-e15ce9e4641b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298a00ba-c312-49e6-9c58-58cffdb3c391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298a00ba-c312-49e6-9c58-58cffdb3c391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54fbf4f5-bcc8-4def-bf67-918fa6759b5f', 'volume_name': 'volume-54fbf4f5-bcc8-4def-bf67-918fa6759b5f', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363b3f88-8620-4f00-aebf-84fcde5c87fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:14 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f3226a18-a84f-4d4a-abe2-af31262640b1 1073741824 Jul 24 09:43:14 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363b3f88-8620-4f00-aebf-84fcde5c87fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfb1633-427f-426a-92e8-9d7394da62c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:14 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Volume 54fbf4f5-bcc8-4def-bf67-918fa6759b5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54fbf4f5-bcc8-4def-bf67-918fa6759b5f', 'volume_size': 1} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Flow 'volume_create_manager' (7bb884c4-7089-49cb-bf0d-5fc449fad0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7504fcdb-d012-4f49-8e03-fd92037e0603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7504fcdb-d012-4f49-8e03-fd92037e0603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1090846134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c30b272-1c43-4e7d-a460-36ab50e3a5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c493a9679842d6bb6ef49d13891dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:14Z,use_quota=True,user_id='240ea39ed04d48fdafffda04e386cf62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d43240f-dfdc-44e6-9977-8c03f897841d),volume_type_id=6d43240f-dfdc-44e6-9977-8c03f897841d)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6714a0a-68e0-4d1b-9872-6b6e91abb8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6714a0a-68e0-4d1b-9872-6b6e91abb8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680431a6-6c67-4aae-8820-c7a4b7e95c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680431a6-6c67-4aae-8820-c7a4b7e95c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c30b272-1c43-4e7d-a460-36ab50e3a5db', 'volume_name': 'volume-3c30b272-1c43-4e7d-a460-36ab50e3a5db', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c93f25e6-799a-49e7-9d06-d8cc605826ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c93f25e6-799a-49e7-9d06-d8cc605826ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d225147-af2d-4a07-a973-8c0930358dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:14 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Volume 3c30b272-1c43-4e7d-a460-36ab50e3a5db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c30b272-1c43-4e7d-a460-36ab50e3a5db', 'volume_size': 1} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:14 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f3226a18-a84f-4d4a-abe2-af31262640b1 1073741824" returned: 0 in 0.814s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f3226a18-a84f-4d4a-abe2-af31262640b1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:14 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f3226a18-a84f-4d4a-abe2-af31262640b1 Jul 24 09:43:14 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:15 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:43:15 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:15 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f3226a18-a84f-4d4a-abe2-af31262640b1" returned: 0 in 0.440s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.221s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2096516175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fbf4f5-bcc8-4def-bf67-918fa6759b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c493a9679842d6bb6ef49d13891dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:14Z,use_quota=True,user_id='240ea39ed04d48fdafffda04e386cf62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd811303-7d68-408f-9891-057e7a23308a),volume_type_id=fd811303-7d68-408f-9891-057e7a23308a)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Creating volume 54fbf4f5-bcc8-4def-bf67-918fa6759b5f {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:43:15 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54fbf4f5-bcc8-4def-bf67-918fa6759b5f 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:15 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.416s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:43:15 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54fbf4f5-bcc8-4def-bf67-918fa6759b5f 1073741824 Jul 24 09:43:15 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e9773a-d8ad-4613-bfca-051680fe1633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3226a18-a84f-4d4a-abe2-af31262640b1', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7d4f12-f8b4-4510-a9f3-46a3060ee199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 28 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:43:15 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Volume volume-f3226a18-a84f-4d4a-abe2-af31262640b1 (f3226a18-a84f-4d4a-abe2-af31262640b1): created successfully Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7d4f12-f8b4-4510-a9f3-46a3060ee199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Flow 'volume_create_manager' (f6591334-844f-49bb-b417-12e8983649ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:15 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-4b75fbe4-3f0f-45dc-8f04-2ce30af386a0 tempest-AbsoluteLimitsTests-1387803397 None] Created volume successfully. Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Flow 'volume_create_manager' (a80cd4f5-37d0-4974-9290-2f9bcbf587d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b86bd85-65ea-4918-a0dd-beff42dd1611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b86bd85-65ea-4918-a0dd-beff42dd1611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1297766772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cce4734-7f85-4495-b6f4-15a92310d91c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c493a9679842d6bb6ef49d13891dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:16Z,use_quota=True,user_id='240ea39ed04d48fdafffda04e386cf62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(663da11b-f6b9-41c4-86c9-73c6a0b23aa2),volume_type_id=663da11b-f6b9-41c4-86c9-73c6a0b23aa2)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf6e756-1115-464c-b8e2-765fd1126827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf6e756-1115-464c-b8e2-765fd1126827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ace397-9375-4d6a-9f58-296723b75d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:15 devstack cinder-volume[88488]: DEBUG cinder.image.glance [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Creating Keystone auth plugin from conf {{(pid=88488) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f310363d-6c9b-47b1-bc9f-3ecc73fe77de tempest-AbsoluteLimitsTests-1387803397 None] Acquiring lock "cinder-f3226a18-a84f-4d4a-abe2-af31262640b1-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f310363d-6c9b-47b1-bc9f-3ecc73fe77de tempest-AbsoluteLimitsTests-1387803397 None] Lock "cinder-f3226a18-a84f-4d4a-abe2-af31262640b1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f310363d-6c9b-47b1-bc9f-3ecc73fe77de tempest-AbsoluteLimitsTests-1387803397 None] Acquiring lock "cinder-quobyte-f3226a18-a84f-4d4a-abe2-af31262640b1" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:43:16 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54fbf4f5-bcc8-4def-bf67-918fa6759b5f 1073741824" returned: 0 in 0.696s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f310363d-6c9b-47b1-bc9f-3ecc73fe77de tempest-AbsoluteLimitsTests-1387803397 None] Lock "cinder-quobyte-f3226a18-a84f-4d4a-abe2-af31262640b1" acquired by "delete_volume" :: waited 0.023s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a679428-16b4-4918-b23a-b5d4866dc59f]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f310363d-6c9b-47b1-bc9f-3ecc73fe77de tempest-AbsoluteLimitsTests-1387803397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f3226a18-a84f-4d4a-abe2-af31262640b1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54fbf4f5-bcc8-4def-bf67-918fa6759b5f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:16 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54fbf4f5-bcc8-4def-bf67-918fa6759b5f Jul 24 09:43:16 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:16 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f3226a18-a84f-4d4a-abe2-af31262640b1 Jul 24 09:43:16 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ace397-9375-4d6a-9f58-296723b75d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9cce4734-7f85-4495-b6f4-15a92310d91c', 'volume_name': 'volume-9cce4734-7f85-4495-b6f4-15a92310d91c', 'volume_size': 1, 'image_id': '2b486622-0e55-4441-a599-0d720e00f115', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b486622-0e55-4441-a599-0d720e00f115', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1771175850', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5c493a9679842d6bb6ef49d13891dbc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b486622-0e55-4441-a599-0d720e00f115', 'created_at': datetime.datetime(2026, 7, 24, 7, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b486622-0e55-4441-a599-0d720e00f115/file', 'properties': {}}, 'image_service': }' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e82b10-c3e4-448d-8a29-140dbd420a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e82b10-c3e4-448d-8a29-140dbd420a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14acfa22-f125-4ccc-abe9-a73b6465d98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:16 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Volume 9cce4734-7f85-4495-b6f4-15a92310d91c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9cce4734-7f85-4495-b6f4-15a92310d91c', 'volume_size': 1, 'image_id': '2b486622-0e55-4441-a599-0d720e00f115', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b486622-0e55-4441-a599-0d720e00f115', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1771175850', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5c493a9679842d6bb6ef49d13891dbc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b486622-0e55-4441-a599-0d720e00f115', 'created_at': datetime.datetime(2026, 7, 24, 7, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b486622-0e55-4441-a599-0d720e00f115/file', 'properties': {}}, 'image_service': } Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Trying to clone 9cce4734-7f85-4495-b6f4-15a92310d91c from image 2b486622-0e55-4441-a599-0d720e00f115 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2b486622-0e55-4441-a599-0d720e00f115', 'metadata': {}}]). {{(pid=88488) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 09:43:16 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54fbf4f5-bcc8-4def-bf67-918fa6759b5f" returned: 0 in 0.390s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.030s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1090846134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c30b272-1c43-4e7d-a460-36ab50e3a5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c493a9679842d6bb6ef49d13891dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:14Z,use_quota=True,user_id='240ea39ed04d48fdafffda04e386cf62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d43240f-dfdc-44e6-9977-8c03f897841d),volume_type_id=6d43240f-dfdc-44e6-9977-8c03f897841d)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Creating volume 3c30b272-1c43-4e7d-a460-36ab50e3a5db {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:43:16 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c30b272-1c43-4e7d-a460-36ab50e3a5db 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:16 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f310363d-6c9b-47b1-bc9f-3ecc73fe77de tempest-AbsoluteLimitsTests-1387803397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f3226a18-a84f-4d4a-abe2-af31262640b1" returned: 0 in 0.515s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f310363d-6c9b-47b1-bc9f-3ecc73fe77de tempest-AbsoluteLimitsTests-1387803397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f3226a18-a84f-4d4a-abe2-af31262640b1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:16 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c30b272-1c43-4e7d-a460-36ab50e3a5db 1073741824 Jul 24 09:43:16 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfb1633-427f-426a-92e8-9d7394da62c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54fbf4f5-bcc8-4def-bf67-918fa6759b5f', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:16 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f3226a18-a84f-4d4a-abe2-af31262640b1 Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fcd2152-ca51-4dc1-96b1-150b863b1e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:16 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:16 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Volume volume-54fbf4f5-bcc8-4def-bf67-918fa6759b5f (54fbf4f5-bcc8-4def-bf67-918fa6759b5f): created successfully Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fcd2152-ca51-4dc1-96b1-150b863b1e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Flow 'volume_create_manager' (60eb0849-82a8-49e0-9038-a5e93447a39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:16 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-8615478b-6b25-4a95-9ed7-f26e4a286646 tempest-TestInstancesWithCinderVolumes-793657892 None] Created volume successfully. Jul 24 09:43:17 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f310363d-6c9b-47b1-bc9f-3ecc73fe77de tempest-AbsoluteLimitsTests-1387803397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f3226a18-a84f-4d4a-abe2-af31262640b1" returned: 0 in 0.514s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f310363d-6c9b-47b1-bc9f-3ecc73fe77de tempest-AbsoluteLimitsTests-1387803397 None] Lock "cinder-quobyte-f3226a18-a84f-4d4a-abe2-af31262640b1" released by "delete_volume" :: held 1.083s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-f310363d-6c9b-47b1-bc9f-3ecc73fe77de tempest-AbsoluteLimitsTests-1387803397 None] Created reservations ['7d1a0439-a4a4-46ad-989f-1b1dfd1cfde4', 'dc0b5bd3-1a9c-4e3e-8f74-6e1768515630', '080ea299-0f9d-4142-a18c-4d10ddfe1409', '61ae9c01-c4db-42f7-964b-12b32863a9f5'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:43:17 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c30b272-1c43-4e7d-a460-36ab50e3a5db 1073741824" returned: 0 in 0.761s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f310363d-6c9b-47b1-bc9f-3ecc73fe77de tempest-AbsoluteLimitsTests-1387803397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f310363d-6c9b-47b1-bc9f-3ecc73fe77de tempest-AbsoluteLimitsTests-1387803397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f310363d-6c9b-47b1-bc9f-3ecc73fe77de tempest-AbsoluteLimitsTests-1387803397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f310363d-6c9b-47b1-bc9f-3ecc73fe77de tempest-AbsoluteLimitsTests-1387803397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f310363d-6c9b-47b1-bc9f-3ecc73fe77de tempest-AbsoluteLimitsTests-1387803397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f310363d-6c9b-47b1-bc9f-3ecc73fe77de tempest-AbsoluteLimitsTests-1387803397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:17 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:43:17 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c30b272-1c43-4e7d-a460-36ab50e3a5db {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:17 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c30b272-1c43-4e7d-a460-36ab50e3a5db Jul 24 09:43:17 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:17 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f310363d-6c9b-47b1-bc9f-3ecc73fe77de tempest-AbsoluteLimitsTests-1387803397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.315s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-f310363d-6c9b-47b1-bc9f-3ecc73fe77de tempest-AbsoluteLimitsTests-1387803397 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:43:17 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-f310363d-6c9b-47b1-bc9f-3ecc73fe77de tempest-AbsoluteLimitsTests-1387803397 None] Deleted volume successfully. Jul 24 09:43:17 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c30b272-1c43-4e7d-a460-36ab50e3a5db" returned: 0 in 0.307s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f310363d-6c9b-47b1-bc9f-3ecc73fe77de tempest-AbsoluteLimitsTests-1387803397 None] Lock "cinder-f3226a18-a84f-4d4a-abe2-af31262640b1-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d225147-af2d-4a07-a973-8c0930358dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c30b272-1c43-4e7d-a460-36ab50e3a5db', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44da1089-b56d-4bed-9575-0533aeb909e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:17 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Volume volume-3c30b272-1c43-4e7d-a460-36ab50e3a5db (3c30b272-1c43-4e7d-a460-36ab50e3a5db): created successfully Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44da1089-b56d-4bed-9575-0533aeb909e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Flow 'volume_create_manager' (7bb884c4-7089-49cb-bf0d-5fc449fad0f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:17 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-bb5e490d-cc79-4b88-9a73-1181e3c015e2 tempest-TestInstancesWithCinderVolumes-793657892 None] Created volume successfully. Jul 24 09:43:20 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2b486622-0e55-4441-a599-0d720e00f115_m4fxdsf0devstack@QuobyteHD, size 20.69 MB, duration 4.28 sec {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 09:43:20 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Image download 20.69 MB at 4.84 MB/s Jul 24 09:43:20 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0c7d58-51ba-40b2-88c0-3e1f365e83f7]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:43:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b486622-0e55-4441-a599-0d720e00f115_m4fxdsf0devstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:20 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b486622-0e55-4441-a599-0d720e00f115_m4fxdsf0devstack@QuobyteHD Jul 24 09:43:20 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:21 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b486622-0e55-4441-a599-0d720e00f115_m4fxdsf0devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:21 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Temporary image 2b486622-0e55-4441-a599-0d720e00f115 is fetched for user 240ea39ed04d48fdafffda04e386cf62. {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 09:43:21 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7968ca9d-e68c-48da-ae3a-8a088c06c42e]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:43:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b486622-0e55-4441-a599-0d720e00f115_m4fxdsf0devstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:21 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b486622-0e55-4441-a599-0d720e00f115_m4fxdsf0devstack@QuobyteHD Jul 24 09:43:21 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:21 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b486622-0e55-4441-a599-0d720e00f115_m4fxdsf0devstack@QuobyteHD" returned: 0 in 0.386s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:21 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1297766772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cce4734-7f85-4495-b6f4-15a92310d91c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c493a9679842d6bb6ef49d13891dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:16Z,use_quota=True,user_id='240ea39ed04d48fdafffda04e386cf62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(663da11b-f6b9-41c4-86c9-73c6a0b23aa2),volume_type_id=663da11b-f6b9-41c4-86c9-73c6a0b23aa2)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:43:21 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Creating volume 9cce4734-7f85-4495-b6f4-15a92310d91c {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:43:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:21 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:21 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:21 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:43:21 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:43:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9cce4734-7f85-4495-b6f4-15a92310d91c 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:21 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9cce4734-7f85-4495-b6f4-15a92310d91c 1073741824 Jul 24 09:43:21 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Flow 'volume_create_manager' (efe78f0d-2a8e-45f7-9ab8-2d385adbaf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6599113-e30d-4637-aa51-e7bab92dc3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6599113-e30d-4637-aa51-e7bab92dc3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-877500362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b34ded-dfe0-4ed3-ba15-039ed69fc20c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0fd373fae445b5bc100c59545fbe95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:22Z,use_quota=True,user_id='56b2f9ad55994b3fa9c47c1d04bc2f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e18257f-f2d1-472f-a0c6-871ddaa051af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e18257f-f2d1-472f-a0c6-871ddaa051af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c12f40-2090-4517-92c3-f8f787247690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c12f40-2090-4517-92c3-f8f787247690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70b34ded-dfe0-4ed3-ba15-039ed69fc20c', 'volume_name': 'volume-70b34ded-dfe0-4ed3-ba15-039ed69fc20c', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7666a99d-d177-470e-96b0-71a48e58e36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7666a99d-d177-470e-96b0-71a48e58e36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b1df56b-014d-49be-a61b-147de9382b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:22 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Volume 70b34ded-dfe0-4ed3-ba15-039ed69fc20c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70b34ded-dfe0-4ed3-ba15-039ed69fc20c', 'volume_size': 1} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:22 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9cce4734-7f85-4495-b6f4-15a92310d91c 1073741824" returned: 0 in 0.683s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9cce4734-7f85-4495-b6f4-15a92310d91c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:22 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9cce4734-7f85-4495-b6f4-15a92310d91c Jul 24 09:43:22 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:22 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9cce4734-7f85-4495-b6f4-15a92310d91c" returned: 0 in 0.262s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.448s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-877500362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b34ded-dfe0-4ed3-ba15-039ed69fc20c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0fd373fae445b5bc100c59545fbe95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:22Z,use_quota=True,user_id='56b2f9ad55994b3fa9c47c1d04bc2f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Creating volume 70b34ded-dfe0-4ed3-ba15-039ed69fc20c {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:43:22 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70b34ded-dfe0-4ed3-ba15-039ed69fc20c 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:22 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70b34ded-dfe0-4ed3-ba15-039ed69fc20c 1073741824 Jul 24 09:43:22 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Attempting download of 2b486622-0e55-4441-a599-0d720e00f115 ((None, [{'url': 'file:///opt/stack/data/glance/images/2b486622-0e55-4441-a599-0d720e00f115', 'metadata': {}}])) to volume 9cce4734-7f85-4495-b6f4-15a92310d91c. {{(pid=88488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[db46ff65-7a12-4252-b65c-84af4dc69b65]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:43:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b486622-0e55-4441-a599-0d720e00f115_524ukhmf {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:23 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b486622-0e55-4441-a599-0d720e00f115_524ukhmf Jul 24 09:43:23 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:23 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70b34ded-dfe0-4ed3-ba15-039ed69fc20c 1073741824" returned: 0 in 0.531s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:23 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b486622-0e55-4441-a599-0d720e00f115_524ukhmf" returned: 0 in 0.442s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b486622-0e55-4441-a599-0d720e00f115_524ukhmf {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70b34ded-dfe0-4ed3-ba15-039ed69fc20c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:23 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70b34ded-dfe0-4ed3-ba15-039ed69fc20c Jul 24 09:43:23 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:23 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b486622-0e55-4441-a599-0d720e00f115_524ukhmf Jul 24 09:43:23 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Flow 'volume_create_manager' (27ffcc21-7cad-40b2-b93d-1494baefc347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb6609f-b0ee-4a2e-ae1f-5c702102868b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb6609f-b0ee-4a2e-ae1f-5c702102868b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-135167625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd398c9-ca36-4ea7-a4ad-682fe4222e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e160d206a241caa3a8d21a08ac957e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:23Z,use_quota=True,user_id='b52b38a4c6644c1fb033d4eae98669bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e79d26d-15be-4672-84ec-03ed5309edeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e79d26d-15be-4672-84ec-03ed5309edeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6774e010-9a5c-47b8-9a1d-4c920d36b1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6774e010-9a5c-47b8-9a1d-4c920d36b1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efd398c9-ca36-4ea7-a4ad-682fe4222e8d', 'volume_name': 'volume-efd398c9-ca36-4ea7-a4ad-682fe4222e8d', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d040e899-7a21-4907-8bb7-322347c735d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d040e899-7a21-4907-8bb7-322347c735d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:23 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dced99fe-dffa-4095-af6b-25c2ae3c7845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:23 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Volume efd398c9-ca36-4ea7-a4ad-682fe4222e8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efd398c9-ca36-4ea7-a4ad-682fe4222e8d', 'volume_size': 1} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70b34ded-dfe0-4ed3-ba15-039ed69fc20c" returned: 0 in 0.342s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:23 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-135167625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd398c9-ca36-4ea7-a4ad-682fe4222e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e160d206a241caa3a8d21a08ac957e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:23Z,use_quota=True,user_id='b52b38a4c6644c1fb033d4eae98669bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Creating volume efd398c9-ca36-4ea7-a4ad-682fe4222e8d {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:43:23 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efd398c9-ca36-4ea7-a4ad-682fe4222e8d 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b486622-0e55-4441-a599-0d720e00f115_524ukhmf" returned: 1 in 0.425s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b486622-0e55-4441-a599-0d720e00f115_524ukhmf' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e120288-7f32-489f-bebe-885a70e84cfa]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b486622-0e55-4441-a599-0d720e00f115_m4fxdsf0devstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:23 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efd398c9-ca36-4ea7-a4ad-682fe4222e8d 1073741824 Jul 24 09:43:23 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b1df56b-014d-49be-a61b-147de9382b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70b34ded-dfe0-4ed3-ba15-039ed69fc20c', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35abbeb1-14fc-43b4-aeb9-c8fc6349a860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:23 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Volume volume-70b34ded-dfe0-4ed3-ba15-039ed69fc20c (70b34ded-dfe0-4ed3-ba15-039ed69fc20c): created successfully Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35abbeb1-14fc-43b4-aeb9-c8fc6349a860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Flow 'volume_create_manager' (efe78f0d-2a8e-45f7-9ab8-2d385adbaf66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:23 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-8876373c-368e-4a2d-9c17-3f0fdb5e9129 tempest-VolumeQuotasAdminTestJSON-105879051 None] Created volume successfully. Jul 24 09:43:23 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b486622-0e55-4441-a599-0d720e00f115_m4fxdsf0devstack@QuobyteHD Jul 24 09:43:23 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:24 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b486622-0e55-4441-a599-0d720e00f115_m4fxdsf0devstack@QuobyteHD" returned: 0 in 0.373s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:24 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] 2b486622-0e55-4441-a599-0d720e00f115 was qcow2, converting to qcow2 {{(pid=88488) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 09:43:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b486622-0e55-4441-a599-0d720e00f115_m4fxdsf0devstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9cce4734-7f85-4495-b6f4-15a92310d91c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:24 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b486622-0e55-4441-a599-0d720e00f115_m4fxdsf0devstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9cce4734-7f85-4495-b6f4-15a92310d91c Jul 24 09:43:24 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:24 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efd398c9-ca36-4ea7-a4ad-682fe4222e8d 1073741824" returned: 0 in 0.485s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efd398c9-ca36-4ea7-a4ad-682fe4222e8d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:24 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efd398c9-ca36-4ea7-a4ad-682fe4222e8d Jul 24 09:43:24 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9e0510b7-3cd8-409e-ada5-59121e7f9aca tempest-VolumeQuotasAdminTestJSON-105879051 None] Acquiring lock "cinder-70b34ded-dfe0-4ed3-ba15-039ed69fc20c-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:43:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9e0510b7-3cd8-409e-ada5-59121e7f9aca tempest-VolumeQuotasAdminTestJSON-105879051 None] Lock "cinder-70b34ded-dfe0-4ed3-ba15-039ed69fc20c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:43:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9e0510b7-3cd8-409e-ada5-59121e7f9aca tempest-VolumeQuotasAdminTestJSON-105879051 None] Acquiring lock "cinder-quobyte-70b34ded-dfe0-4ed3-ba15-039ed69fc20c" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:43:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9e0510b7-3cd8-409e-ada5-59121e7f9aca tempest-VolumeQuotasAdminTestJSON-105879051 None] Lock "cinder-quobyte-70b34ded-dfe0-4ed3-ba15-039ed69fc20c" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:43:24 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53a904e-2c3c-42f2-8da3-16a20602b923]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:43:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9e0510b7-3cd8-409e-ada5-59121e7f9aca tempest-VolumeQuotasAdminTestJSON-105879051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70b34ded-dfe0-4ed3-ba15-039ed69fc20c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:24 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efd398c9-ca36-4ea7-a4ad-682fe4222e8d" returned: 0 in 0.305s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:43:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dced99fe-dffa-4095-af6b-25c2ae3c7845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efd398c9-ca36-4ea7-a4ad-682fe4222e8d', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55bb26e-14ba-4bde-b7a1-b9881c1a11ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:24 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Volume volume-efd398c9-ca36-4ea7-a4ad-682fe4222e8d (efd398c9-ca36-4ea7-a4ad-682fe4222e8d): created successfully Jul 24 09:43:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55bb26e-14ba-4bde-b7a1-b9881c1a11ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Flow 'volume_create_manager' (27ffcc21-7cad-40b2-b93d-1494baefc347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:24 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70b34ded-dfe0-4ed3-ba15-039ed69fc20c Jul 24 09:43:24 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-45804b6e-22ac-4de3-8da2-3f66c2010426 tempest-VolumesMetadataTest-1562586883 None] Created volume successfully. Jul 24 09:43:24 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:24 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9e0510b7-3cd8-409e-ada5-59121e7f9aca tempest-VolumeQuotasAdminTestJSON-105879051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70b34ded-dfe0-4ed3-ba15-039ed69fc20c" returned: 0 in 0.405s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9e0510b7-3cd8-409e-ada5-59121e7f9aca tempest-VolumeQuotasAdminTestJSON-105879051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70b34ded-dfe0-4ed3-ba15-039ed69fc20c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:24 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70b34ded-dfe0-4ed3-ba15-039ed69fc20c Jul 24 09:43:24 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:25 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9e0510b7-3cd8-409e-ada5-59121e7f9aca tempest-VolumeQuotasAdminTestJSON-105879051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70b34ded-dfe0-4ed3-ba15-039ed69fc20c" returned: 0 in 0.242s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9e0510b7-3cd8-409e-ada5-59121e7f9aca tempest-VolumeQuotasAdminTestJSON-105879051 None] Lock "cinder-quobyte-70b34ded-dfe0-4ed3-ba15-039ed69fc20c" released by "delete_volume" :: held 0.692s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:43:25 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-9e0510b7-3cd8-409e-ada5-59121e7f9aca tempest-VolumeQuotasAdminTestJSON-105879051 None] Created reservations ['143b2b2d-f778-4600-bd16-5c42786fd392', 'effba70c-ffb4-4f22-94c6-7e7d0ec84ed5', 'f6c221ff-14a3-4b23-9468-fe4e1e41acd9', '597d8dd8-fa7e-415c-b136-38f1fdc3bfff'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:43:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9e0510b7-3cd8-409e-ada5-59121e7f9aca tempest-VolumeQuotasAdminTestJSON-105879051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9e0510b7-3cd8-409e-ada5-59121e7f9aca tempest-VolumeQuotasAdminTestJSON-105879051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9e0510b7-3cd8-409e-ada5-59121e7f9aca tempest-VolumeQuotasAdminTestJSON-105879051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9e0510b7-3cd8-409e-ada5-59121e7f9aca tempest-VolumeQuotasAdminTestJSON-105879051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9e0510b7-3cd8-409e-ada5-59121e7f9aca tempest-VolumeQuotasAdminTestJSON-105879051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9e0510b7-3cd8-409e-ada5-59121e7f9aca tempest-VolumeQuotasAdminTestJSON-105879051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:25 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:43:25 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:25 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9e0510b7-3cd8-409e-ada5-59121e7f9aca tempest-VolumeQuotasAdminTestJSON-105879051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.265s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:25 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-9e0510b7-3cd8-409e-ada5-59121e7f9aca tempest-VolumeQuotasAdminTestJSON-105879051 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:43:25 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-9e0510b7-3cd8-409e-ada5-59121e7f9aca tempest-VolumeQuotasAdminTestJSON-105879051 None] Deleted volume successfully. Jul 24 09:43:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9e0510b7-3cd8-409e-ada5-59121e7f9aca tempest-VolumeQuotasAdminTestJSON-105879051 None] Lock "cinder-70b34ded-dfe0-4ed3-ba15-039ed69fc20c-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Flow 'volume_create_manager' (82556c18-fe5a-4739-a42a-6045202ee388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ff91e0c-4d3e-499a-aa5b-48efd4913544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ff91e0c-4d3e-499a-aa5b-48efd4913544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1771693397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e324cfe9-c820-49b5-988d-04571621357b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c91ec74a7dc4749a80f889e919e9dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:26Z,use_quota=True,user_id='bab53e5243fb44b1a20fbb6cee3f6475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (075bbc2f-5c5c-4516-a2e0-b22c7697348b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (075bbc2f-5c5c-4516-a2e0-b22c7697348b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b4b411-4a1b-4fe8-82b4-41613a478bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b4b411-4a1b-4fe8-82b4-41613a478bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e324cfe9-c820-49b5-988d-04571621357b', 'volume_name': 'volume-e324cfe9-c820-49b5-988d-04571621357b', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:26 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e839b2f-de16-41c1-9c2c-c38004374a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e839b2f-de16-41c1-9c2c-c38004374a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e2db55-96e1-445d-a35e-206d324436d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:26 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Volume e324cfe9-c820-49b5-988d-04571621357b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e324cfe9-c820-49b5-988d-04571621357b', 'volume_size': 1} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1771693397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e324cfe9-c820-49b5-988d-04571621357b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c91ec74a7dc4749a80f889e919e9dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:26Z,use_quota=True,user_id='bab53e5243fb44b1a20fbb6cee3f6475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Creating volume e324cfe9-c820-49b5-988d-04571621357b {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:43:26 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e324cfe9-c820-49b5-988d-04571621357b 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b486622-0e55-4441-a599-0d720e00f115_m4fxdsf0devstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9cce4734-7f85-4495-b6f4-15a92310d91c" returned: 0 in 2.039s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2b486622-0e55-4441-a599-0d720e00f115_m4fxdsf0devstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9cce4734-7f85-4495-b6f4-15a92310d91c {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:43:26 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Converted 112.00 MB image at 54.87 MB/s Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9cce4734-7f85-4495-b6f4-15a92310d91c 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:26 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e324cfe9-c820-49b5-988d-04571621357b 1073741824 Jul 24 09:43:26 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:26 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9cce4734-7f85-4495-b6f4-15a92310d91c 1G Jul 24 09:43:26 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Flow 'volume_create_manager' (4d40a763-6419-4942-92c2-c5b4dfbe3466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d70649-0d07-4b4d-b584-6134faaa429c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d70649-0d07-4b4d-b584-6134faaa429c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-149476820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee695ff-746b-49c9-8b29-fa9b8dd9326a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0fd373fae445b5bc100c59545fbe95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:26Z,use_quota=True,user_id='56b2f9ad55994b3fa9c47c1d04bc2f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fd413f-2465-42ff-8a68-234e90b397b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fd413f-2465-42ff-8a68-234e90b397b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b43965c-54c1-4216-9b16-21ac15dc812b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b43965c-54c1-4216-9b16-21ac15dc812b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fee695ff-746b-49c9-8b29-fa9b8dd9326a', 'volume_name': 'volume-fee695ff-746b-49c9-8b29-fa9b8dd9326a', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f96e31f0-f2c6-4f26-a7c7-dd61439812a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f96e31f0-f2c6-4f26-a7c7-dd61439812a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd730051-bd01-4d79-bd27-763ca0cf6a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:26 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Volume fee695ff-746b-49c9-8b29-fa9b8dd9326a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fee695ff-746b-49c9-8b29-fa9b8dd9326a', 'volume_size': 1} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:26 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9cce4734-7f85-4495-b6f4-15a92310d91c 1G" returned: 0 in 0.386s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Downloaded image 2b486622-0e55-4441-a599-0d720e00f115 ((None, [{'url': 'file:///opt/stack/data/glance/images/2b486622-0e55-4441-a599-0d720e00f115', 'metadata': {}}])) to volume 9cce4734-7f85-4495-b6f4-15a92310d91c successfully. {{(pid=88488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Temporary image 2b486622-0e55-4441-a599-0d720e00f115 for user 240ea39ed04d48fdafffda04e386cf62 is deleted. {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Marking volume 9cce4734-7f85-4495-b6f4-15a92310d91c as bootable. {{(pid=88488) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Copying metadata from image 2b486622-0e55-4441-a599-0d720e00f115 to 9cce4734-7f85-4495-b6f4-15a92310d91c. {{(pid=88488) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Creating volume glance metadata for volume 9cce4734-7f85-4495-b6f4-15a92310d91c backed by image 2b486622-0e55-4441-a599-0d720e00f115 with: {'image_id': '2b486622-0e55-4441-a599-0d720e00f115', 'image_name': 'tempest-scenario-img--1771175850', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88488) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14acfa22-f125-4ccc-abe9-a73b6465d98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cce4734-7f85-4495-b6f4-15a92310d91c', 'volume_size': 1, 'image_id': '2b486622-0e55-4441-a599-0d720e00f115', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b486622-0e55-4441-a599-0d720e00f115', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1771175850', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5c493a9679842d6bb6ef49d13891dbc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b486622-0e55-4441-a599-0d720e00f115', 'created_at': datetime.datetime(2026, 7, 24, 7, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b486622-0e55-4441-a599-0d720e00f115/file', 'properties': {}}, 'image_service': }' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1031920-5d79-4d1a-a51e-0d6f70d8f76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:26 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Volume volume-9cce4734-7f85-4495-b6f4-15a92310d91c (9cce4734-7f85-4495-b6f4-15a92310d91c): created successfully Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1031920-5d79-4d1a-a51e-0d6f70d8f76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Flow 'volume_create_manager' (a80cd4f5-37d0-4974-9290-2f9bcbf587d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8f3de474-ef37-4919-a926-a83cbe4d2509 tempest-VolumesMetadataTest-1562586883 None] Acquiring lock "cinder-efd398c9-ca36-4ea7-a4ad-682fe4222e8d-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:43:26 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-7ab71588-bb15-4a23-acad-0ca88b855e34 tempest-TestInstancesWithCinderVolumes-793657892 None] Created volume successfully. Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8f3de474-ef37-4919-a926-a83cbe4d2509 tempest-VolumesMetadataTest-1562586883 None] Lock "cinder-efd398c9-ca36-4ea7-a4ad-682fe4222e8d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:43:26 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e324cfe9-c820-49b5-988d-04571621357b 1073741824" returned: 0 in 0.589s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8f3de474-ef37-4919-a926-a83cbe4d2509 tempest-VolumesMetadataTest-1562586883 None] Acquiring lock "cinder-quobyte-efd398c9-ca36-4ea7-a4ad-682fe4222e8d" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8f3de474-ef37-4919-a926-a83cbe4d2509 tempest-VolumesMetadataTest-1562586883 None] Lock "cinder-quobyte-efd398c9-ca36-4ea7-a4ad-682fe4222e8d" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e324cfe9-c820-49b5-988d-04571621357b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9027e341-6ff2-44dc-b5f1-2b4c73b3b525]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:43:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8f3de474-ef37-4919-a926-a83cbe4d2509 tempest-VolumesMetadataTest-1562586883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efd398c9-ca36-4ea7-a4ad-682fe4222e8d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:26 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e324cfe9-c820-49b5-988d-04571621357b Jul 24 09:43:26 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:26 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efd398c9-ca36-4ea7-a4ad-682fe4222e8d Jul 24 09:43:26 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:27 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e324cfe9-c820-49b5-988d-04571621357b" returned: 0 in 0.264s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.706s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-149476820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee695ff-746b-49c9-8b29-fa9b8dd9326a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0fd373fae445b5bc100c59545fbe95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:26Z,use_quota=True,user_id='56b2f9ad55994b3fa9c47c1d04bc2f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Creating volume fee695ff-746b-49c9-8b29-fa9b8dd9326a {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:43:27 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fee695ff-746b-49c9-8b29-fa9b8dd9326a 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e2db55-96e1-445d-a35e-206d324436d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e324cfe9-c820-49b5-988d-04571621357b', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:27 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fee695ff-746b-49c9-8b29-fa9b8dd9326a 1073741824 Jul 24 09:43:27 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9949aceb-bd59-4429-bb9c-90b4d62dcfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:27 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Volume volume-e324cfe9-c820-49b5-988d-04571621357b (e324cfe9-c820-49b5-988d-04571621357b): created successfully Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9949aceb-bd59-4429-bb9c-90b4d62dcfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Flow 'volume_create_manager' (82556c18-fe5a-4739-a42a-6045202ee388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:27 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-6c80ec75-ff1e-4d67-9408-7e788d0d3df9 tempest-AttachVolumeTestJSON-426441744 None] Created volume successfully. Jul 24 09:43:27 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8f3de474-ef37-4919-a926-a83cbe4d2509 tempest-VolumesMetadataTest-1562586883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efd398c9-ca36-4ea7-a4ad-682fe4222e8d" returned: 0 in 0.398s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8f3de474-ef37-4919-a926-a83cbe4d2509 tempest-VolumesMetadataTest-1562586883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efd398c9-ca36-4ea7-a4ad-682fe4222e8d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:27 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efd398c9-ca36-4ea7-a4ad-682fe4222e8d Jul 24 09:43:27 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:27 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8f3de474-ef37-4919-a926-a83cbe4d2509 tempest-VolumesMetadataTest-1562586883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efd398c9-ca36-4ea7-a4ad-682fe4222e8d" returned: 0 in 0.263s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8f3de474-ef37-4919-a926-a83cbe4d2509 tempest-VolumesMetadataTest-1562586883 None] Lock "cinder-quobyte-efd398c9-ca36-4ea7-a4ad-682fe4222e8d" released by "delete_volume" :: held 0.705s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:43:27 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fee695ff-746b-49c9-8b29-fa9b8dd9326a 1073741824" returned: 0 in 0.433s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-8f3de474-ef37-4919-a926-a83cbe4d2509 tempest-VolumesMetadataTest-1562586883 None] Created reservations ['504cf777-11e8-44b2-9437-fc2b6e3c7f20', '70b1c54d-2ef1-4fa5-bbba-5e9c4db717ee', 'e053140f-d6a4-4437-99cc-2ecbe56c63f2', '7cc8e939-cec2-42c8-b4bf-2f4e295e22e6'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fee695ff-746b-49c9-8b29-fa9b8dd9326a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:27 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fee695ff-746b-49c9-8b29-fa9b8dd9326a Jul 24 09:43:27 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8f3de474-ef37-4919-a926-a83cbe4d2509 tempest-VolumesMetadataTest-1562586883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8f3de474-ef37-4919-a926-a83cbe4d2509 tempest-VolumesMetadataTest-1562586883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8f3de474-ef37-4919-a926-a83cbe4d2509 tempest-VolumesMetadataTest-1562586883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8f3de474-ef37-4919-a926-a83cbe4d2509 tempest-VolumesMetadataTest-1562586883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8f3de474-ef37-4919-a926-a83cbe4d2509 tempest-VolumesMetadataTest-1562586883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8f3de474-ef37-4919-a926-a83cbe4d2509 tempest-VolumesMetadataTest-1562586883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:27 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:43:27 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:27 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fee695ff-746b-49c9-8b29-fa9b8dd9326a" returned: 0 in 0.277s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd730051-bd01-4d79-bd27-763ca0cf6a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fee695ff-746b-49c9-8b29-fa9b8dd9326a', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12775a6f-67ae-45a7-b743-5cca1a09d59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:27 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Volume volume-fee695ff-746b-49c9-8b29-fa9b8dd9326a (fee695ff-746b-49c9-8b29-fa9b8dd9326a): created successfully Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12775a6f-67ae-45a7-b743-5cca1a09d59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Flow 'volume_create_manager' (4d40a763-6419-4942-92c2-c5b4dfbe3466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:27 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-4d33f547-e417-4655-8d38-27d61f1875bf tempest-VolumeQuotasAdminTestJSON-105879051 None] Created volume successfully. Jul 24 09:43:27 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8f3de474-ef37-4919-a926-a83cbe4d2509 tempest-VolumesMetadataTest-1562586883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.288s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-8f3de474-ef37-4919-a926-a83cbe4d2509 tempest-VolumesMetadataTest-1562586883 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:43:27 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-8f3de474-ef37-4919-a926-a83cbe4d2509 tempest-VolumesMetadataTest-1562586883 None] Deleted volume successfully. Jul 24 09:43:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8f3de474-ef37-4919-a926-a83cbe4d2509 tempest-VolumesMetadataTest-1562586883 None] Lock "cinder-efd398c9-ca36-4ea7-a4ad-682fe4222e8d-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:43:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-5f96056f-49c4-440a-bc5a-d97a3ad44f4d req-c5633aec-60f0-41fc-9d74-2ef37e22e726 tempest-AttachVolumeTestJSON-426441744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-5f96056f-49c4-440a-bc5a-d97a3ad44f4d req-c5633aec-60f0-41fc-9d74-2ef37e22e726 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-5f96056f-49c4-440a-bc5a-d97a3ad44f4d req-c5633aec-60f0-41fc-9d74-2ef37e22e726 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-5f96056f-49c4-440a-bc5a-d97a3ad44f4d req-c5633aec-60f0-41fc-9d74-2ef37e22e726 tempest-AttachVolumeTestJSON-426441744 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-e324cfe9-c820-49b5-988d-04571621357b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '050c460c-f0c8-44cb-9659-79a062c42c05', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:43:29 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b204f154-1a05-4d2e-be10-dcfe6b64617f tempest-VolumeQuotasAdminTestJSON-2040380371 None] Transfer volume completed successfully. Jul 24 09:43:29 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-5f96056f-49c4-440a-bc5a-d97a3ad44f4d req-c5633aec-60f0-41fc-9d74-2ef37e22e726 tempest-AttachVolumeTestJSON-426441744 None] attachment_update completed successfully. Jul 24 09:43:30 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-630173e9-b2c7-4bd5-aaef-db7f6a3e428d tempest-VolumeQuotasAdminTestJSON-1240758497 None] Acquiring lock "cinder-fee695ff-746b-49c9-8b29-fa9b8dd9326a-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:43:30 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-630173e9-b2c7-4bd5-aaef-db7f6a3e428d tempest-VolumeQuotasAdminTestJSON-1240758497 None] Lock "cinder-fee695ff-746b-49c9-8b29-fa9b8dd9326a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:43:30 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-630173e9-b2c7-4bd5-aaef-db7f6a3e428d tempest-VolumeQuotasAdminTestJSON-1240758497 None] Acquiring lock "cinder-quobyte-fee695ff-746b-49c9-8b29-fa9b8dd9326a" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:43:30 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-630173e9-b2c7-4bd5-aaef-db7f6a3e428d tempest-VolumeQuotasAdminTestJSON-1240758497 None] Lock "cinder-quobyte-fee695ff-746b-49c9-8b29-fa9b8dd9326a" acquired by "delete_volume" :: waited 0.026s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:43:30 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdbae00-fd16-4244-988d-3dceb9116ceb]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:43:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-630173e9-b2c7-4bd5-aaef-db7f6a3e428d tempest-VolumeQuotasAdminTestJSON-1240758497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fee695ff-746b-49c9-8b29-fa9b8dd9326a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:30 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fee695ff-746b-49c9-8b29-fa9b8dd9326a Jul 24 09:43:30 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:31 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-630173e9-b2c7-4bd5-aaef-db7f6a3e428d tempest-VolumeQuotasAdminTestJSON-1240758497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fee695ff-746b-49c9-8b29-fa9b8dd9326a" returned: 0 in 0.674s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-630173e9-b2c7-4bd5-aaef-db7f6a3e428d tempest-VolumeQuotasAdminTestJSON-1240758497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fee695ff-746b-49c9-8b29-fa9b8dd9326a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:31 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fee695ff-746b-49c9-8b29-fa9b8dd9326a Jul 24 09:43:31 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-a97bcae1-5061-4b2a-b708-88420c5ce71c req-3c8c0709-3461-4491-9434-138862ce337e tempest-TestInstancesWithCinderVolumes-793657892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-a97bcae1-5061-4b2a-b708-88420c5ce71c req-3c8c0709-3461-4491-9434-138862ce337e tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-a97bcae1-5061-4b2a-b708-88420c5ce71c req-3c8c0709-3461-4491-9434-138862ce337e tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:31 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-a97bcae1-5061-4b2a-b708-88420c5ce71c req-3c8c0709-3461-4491-9434-138862ce337e tempest-TestInstancesWithCinderVolumes-793657892 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-9cce4734-7f85-4495-b6f4-15a92310d91c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af61fe56-fbef-4828-a57d-db4dfac539b1', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:43:31 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-630173e9-b2c7-4bd5-aaef-db7f6a3e428d tempest-VolumeQuotasAdminTestJSON-1240758497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fee695ff-746b-49c9-8b29-fa9b8dd9326a" returned: 0 in 0.460s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-630173e9-b2c7-4bd5-aaef-db7f6a3e428d tempest-VolumeQuotasAdminTestJSON-1240758497 None] Lock "cinder-quobyte-fee695ff-746b-49c9-8b29-fa9b8dd9326a" released by "delete_volume" :: held 1.198s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:43:31 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-a97bcae1-5061-4b2a-b708-88420c5ce71c req-3c8c0709-3461-4491-9434-138862ce337e tempest-TestInstancesWithCinderVolumes-793657892 None] attachment_update completed successfully. Jul 24 09:43:31 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-630173e9-b2c7-4bd5-aaef-db7f6a3e428d tempest-VolumeQuotasAdminTestJSON-1240758497 None] Created reservations ['da41109b-8522-4766-bf22-668f2524c519', 'bbe0f855-e59c-4436-96af-8cd38d751169', '25ea5985-12bb-4639-8271-cc4ca195eb93', 'da9a55ab-39a1-40d2-8343-de1355ddf6c2'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:43:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-630173e9-b2c7-4bd5-aaef-db7f6a3e428d tempest-VolumeQuotasAdminTestJSON-1240758497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-630173e9-b2c7-4bd5-aaef-db7f6a3e428d tempest-VolumeQuotasAdminTestJSON-1240758497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-630173e9-b2c7-4bd5-aaef-db7f6a3e428d tempest-VolumeQuotasAdminTestJSON-1240758497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-630173e9-b2c7-4bd5-aaef-db7f6a3e428d tempest-VolumeQuotasAdminTestJSON-1240758497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-630173e9-b2c7-4bd5-aaef-db7f6a3e428d tempest-VolumeQuotasAdminTestJSON-1240758497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-630173e9-b2c7-4bd5-aaef-db7f6a3e428d tempest-VolumeQuotasAdminTestJSON-1240758497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:31 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:43:31 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:32 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-630173e9-b2c7-4bd5-aaef-db7f6a3e428d tempest-VolumeQuotasAdminTestJSON-1240758497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.386s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-630173e9-b2c7-4bd5-aaef-db7f6a3e428d tempest-VolumeQuotasAdminTestJSON-1240758497 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:43:32 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-630173e9-b2c7-4bd5-aaef-db7f6a3e428d tempest-VolumeQuotasAdminTestJSON-1240758497 None] Deleted volume successfully. Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-630173e9-b2c7-4bd5-aaef-db7f6a3e428d tempest-VolumeQuotasAdminTestJSON-1240758497 None] Lock "cinder-fee695ff-746b-49c9-8b29-fa9b8dd9326a-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Flow 'volume_create_manager' (daea83c3-997f-407b-a2fe-131ca948221d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4ae946-a80f-463b-82f7-50dfba19c2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4ae946-a80f-463b-82f7-50dfba19c2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2081821016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a380ec-b24d-4a5f-ad53-cd8efbad4017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c91ec74a7dc4749a80f889e919e9dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:32Z,use_quota=True,user_id='bab53e5243fb44b1a20fbb6cee3f6475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89b1c59-6ec3-4eed-afcb-7653b6b51f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89b1c59-6ec3-4eed-afcb-7653b6b51f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56336212-8d2c-46e2-833e-990eabcd9e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56336212-8d2c-46e2-833e-990eabcd9e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53a380ec-b24d-4a5f-ad53-cd8efbad4017', 'volume_name': 'volume-53a380ec-b24d-4a5f-ad53-cd8efbad4017', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b008304f-8cd0-4574-9bd3-d93973216d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b008304f-8cd0-4574-9bd3-d93973216d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c15e188-211c-43c1-9d0d-8dbd52478b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:32 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Volume 53a380ec-b24d-4a5f-ad53-cd8efbad4017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53a380ec-b24d-4a5f-ad53-cd8efbad4017', 'volume_size': 1} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2081821016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a380ec-b24d-4a5f-ad53-cd8efbad4017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c91ec74a7dc4749a80f889e919e9dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:32Z,use_quota=True,user_id='bab53e5243fb44b1a20fbb6cee3f6475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Creating volume 53a380ec-b24d-4a5f-ad53-cd8efbad4017 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:43:32 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:43:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-53a380ec-b24d-4a5f-ad53-cd8efbad4017 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:32 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-53a380ec-b24d-4a5f-ad53-cd8efbad4017 1073741824 Jul 24 09:43:32 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:33 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-53a380ec-b24d-4a5f-ad53-cd8efbad4017 1073741824" returned: 0 in 0.633s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-53a380ec-b24d-4a5f-ad53-cd8efbad4017 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:33 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-53a380ec-b24d-4a5f-ad53-cd8efbad4017 Jul 24 09:43:33 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:33 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-53a380ec-b24d-4a5f-ad53-cd8efbad4017" returned: 0 in 0.363s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:43:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c15e188-211c-43c1-9d0d-8dbd52478b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53a380ec-b24d-4a5f-ad53-cd8efbad4017', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6459114-c031-4d5b-a0d4-7a2a9474b9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:33 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Volume volume-53a380ec-b24d-4a5f-ad53-cd8efbad4017 (53a380ec-b24d-4a5f-ad53-cd8efbad4017): created successfully Jul 24 09:43:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6459114-c031-4d5b-a0d4-7a2a9474b9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Flow 'volume_create_manager' (daea83c3-997f-407b-a2fe-131ca948221d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:33 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-7719c129-eb47-4ce8-94dd-47375af97302 tempest-AttachVolumeTestJSON-426441744 None] Created volume successfully. Jul 24 09:43:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-7f60927a-86c3-45e7-9baa-955ab7e58ee2 req-b2a0cdcd-208e-465f-870a-4b8f5000a3ad tempest-AttachVolumeTestJSON-426441744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-7f60927a-86c3-45e7-9baa-955ab7e58ee2 req-b2a0cdcd-208e-465f-870a-4b8f5000a3ad tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-7f60927a-86c3-45e7-9baa-955ab7e58ee2 req-b2a0cdcd-208e-465f-870a-4b8f5000a3ad tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-7f60927a-86c3-45e7-9baa-955ab7e58ee2 req-b2a0cdcd-208e-465f-870a-4b8f5000a3ad tempest-AttachVolumeTestJSON-426441744 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-53a380ec-b24d-4a5f-ad53-cd8efbad4017', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60dfd1c4-a373-48ab-8ca6-d2802e398216', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:43:36 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-7f60927a-86c3-45e7-9baa-955ab7e58ee2 req-b2a0cdcd-208e-465f-870a-4b8f5000a3ad tempest-AttachVolumeTestJSON-426441744 None] attachment_update completed successfully. Jul 24 09:43:39 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=102,cinder:INSERT=28,cinder:UPDATE=103,cinder:DELETE=9 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:43:39 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=111,cinder:SELECT=109,cinder:DELETE=7,cinder:INSERT=37 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:43:39 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-92a8b7d6-a5f3-4daf-9999-a1f1d7c86916 req-aebb7c21-ab9f-40f7-84d0-3540da9a803e tempest-AttachVolumeTestJSON-426441744 None] Terminate volume connection completed successfully. Jul 24 09:43:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-92a8b7d6-a5f3-4daf-9999-a1f1d7c86916 req-aebb7c21-ab9f-40f7-84d0-3540da9a803e tempest-AttachVolumeTestJSON-426441744 None] Deleting attachment 050c460c-f0c8-44cb-9659-79a062c42c05. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:43:42 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-80c6f347-522b-42c7-a2e5-c5c0e446d804 req-f75b4a81-8390-4fad-979c-b0bdbfafc3e7 tempest-AttachVolumeTestJSON-426441744 None] Terminate volume connection completed successfully. Jul 24 09:43:42 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-80c6f347-522b-42c7-a2e5-c5c0e446d804 req-f75b4a81-8390-4fad-979c-b0bdbfafc3e7 tempest-AttachVolumeTestJSON-426441744 None] Deleting attachment 60dfd1c4-a373-48ab-8ca6-d2802e398216. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Flow 'volume_create_manager' (761bc399-0323-4e5d-bcae-e4a2c9552a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f500725-78ec-45b0-a5fd-a0a680711995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f500725-78ec-45b0-a5fd-a0a680711995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1082792708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda3fc70-32d3-46a5-b565-42dc4c6dcb44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32232cac6a4542949eb306df6afdfd99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:45Z,use_quota=True,user_id='17508877383d45f09af08e2ea2439de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f494d07f-6f26-4731-bdbe-595a8a2625ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f494d07f-6f26-4731-bdbe-595a8a2625ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1b478c-7e59-435e-9d4e-155c7dad0169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1b478c-7e59-435e-9d4e-155c7dad0169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dda3fc70-32d3-46a5-b565-42dc4c6dcb44', 'volume_name': 'volume-dda3fc70-32d3-46a5-b565-42dc4c6dcb44', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9bce37-2992-4eea-9d51-af5f6bfacad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9bce37-2992-4eea-9d51-af5f6bfacad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9cea064-aa7d-46f9-a1c8-0ad03a8e7f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:45 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Volume dda3fc70-32d3-46a5-b565-42dc4c6dcb44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dda3fc70-32d3-46a5-b565-42dc4c6dcb44', 'volume_size': 1} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1082792708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda3fc70-32d3-46a5-b565-42dc4c6dcb44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32232cac6a4542949eb306df6afdfd99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:45Z,use_quota=True,user_id='17508877383d45f09af08e2ea2439de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Creating volume dda3fc70-32d3-46a5-b565-42dc4c6dcb44 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:43:45 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:43:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-dda3fc70-32d3-46a5-b565-42dc4c6dcb44 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:45 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-dda3fc70-32d3-46a5-b565-42dc4c6dcb44 1073741824 Jul 24 09:43:45 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:46 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-dda3fc70-32d3-46a5-b565-42dc4c6dcb44 1073741824" returned: 0 in 0.614s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-dda3fc70-32d3-46a5-b565-42dc4c6dcb44 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:46 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-dda3fc70-32d3-46a5-b565-42dc4c6dcb44 Jul 24 09:43:46 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:46 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-dda3fc70-32d3-46a5-b565-42dc4c6dcb44" returned: 0 in 0.307s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:43:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9cea064-aa7d-46f9-a1c8-0ad03a8e7f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dda3fc70-32d3-46a5-b565-42dc4c6dcb44', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d1d7bf-5260-4c40-a174-12da40ab513f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:46 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Volume volume-dda3fc70-32d3-46a5-b565-42dc4c6dcb44 (dda3fc70-32d3-46a5-b565-42dc4c6dcb44): created successfully Jul 24 09:43:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d1d7bf-5260-4c40-a174-12da40ab513f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Flow 'volume_create_manager' (761bc399-0323-4e5d-bcae-e4a2c9552a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:46 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-a6454e5f-ed94-4b82-9640-367086d11606 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Created volume successfully. Jul 24 09:43:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-50149330-bf01-42df-870e-40ef8aae2cf6 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Acquiring lock "cinder-dda3fc70-32d3-46a5-b565-42dc4c6dcb44-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:43:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-50149330-bf01-42df-870e-40ef8aae2cf6 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Lock "cinder-dda3fc70-32d3-46a5-b565-42dc4c6dcb44-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:43:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-50149330-bf01-42df-870e-40ef8aae2cf6 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Acquiring lock "cinder-quobyte-dda3fc70-32d3-46a5-b565-42dc4c6dcb44" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:43:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-50149330-bf01-42df-870e-40ef8aae2cf6 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Lock "cinder-quobyte-dda3fc70-32d3-46a5-b565-42dc4c6dcb44" acquired by "delete_volume" :: waited 0.021s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:43:49 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1341e1ee-c49d-42d1-94b6-5054f6267c05]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:43:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-50149330-bf01-42df-870e-40ef8aae2cf6 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-dda3fc70-32d3-46a5-b565-42dc4c6dcb44 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:49 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-dda3fc70-32d3-46a5-b565-42dc4c6dcb44 Jul 24 09:43:49 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:50 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-50149330-bf01-42df-870e-40ef8aae2cf6 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-dda3fc70-32d3-46a5-b565-42dc4c6dcb44" returned: 0 in 0.509s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-50149330-bf01-42df-870e-40ef8aae2cf6 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-dda3fc70-32d3-46a5-b565-42dc4c6dcb44 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:50 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-dda3fc70-32d3-46a5-b565-42dc4c6dcb44 Jul 24 09:43:50 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:50 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-50149330-bf01-42df-870e-40ef8aae2cf6 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-dda3fc70-32d3-46a5-b565-42dc4c6dcb44" returned: 0 in 0.478s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:50 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-50149330-bf01-42df-870e-40ef8aae2cf6 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Lock "cinder-quobyte-dda3fc70-32d3-46a5-b565-42dc4c6dcb44" released by "delete_volume" :: held 1.074s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:43:50 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-50149330-bf01-42df-870e-40ef8aae2cf6 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Created reservations ['02a1983a-33ff-437b-8f0e-0973af091e08', '8d08ea38-23a3-47f4-a7a9-1cd608b5f099', '0f5d2cea-2a16-4f54-bc9b-09d6102d663e', '75f7f59e-623c-4999-9ef8-b1cd67a2dead'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:43:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-50149330-bf01-42df-870e-40ef8aae2cf6 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-50149330-bf01-42df-870e-40ef8aae2cf6 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:50 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-50149330-bf01-42df-870e-40ef8aae2cf6 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:50 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-50149330-bf01-42df-870e-40ef8aae2cf6 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-50149330-bf01-42df-870e-40ef8aae2cf6 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-50149330-bf01-42df-870e-40ef8aae2cf6 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:50 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:43:50 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:51 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-50149330-bf01-42df-870e-40ef8aae2cf6 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.522s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:51 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-50149330-bf01-42df-870e-40ef8aae2cf6 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:43:51 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-50149330-bf01-42df-870e-40ef8aae2cf6 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Deleted volume successfully. Jul 24 09:43:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-50149330-bf01-42df-870e-40ef8aae2cf6 tempest-VolumeQuotasNegativeTestJSON-1700158344 None] Lock "cinder-dda3fc70-32d3-46a5-b565-42dc4c6dcb44-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:43:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5cc5accc-7d25-4516-9855-59bd1c0de700 tempest-AttachVolumeTestJSON-426441744 None] Acquiring lock "cinder-53a380ec-b24d-4a5f-ad53-cd8efbad4017-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:43:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5cc5accc-7d25-4516-9855-59bd1c0de700 tempest-AttachVolumeTestJSON-426441744 None] Lock "cinder-53a380ec-b24d-4a5f-ad53-cd8efbad4017-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:43:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5cc5accc-7d25-4516-9855-59bd1c0de700 tempest-AttachVolumeTestJSON-426441744 None] Acquiring lock "cinder-quobyte-53a380ec-b24d-4a5f-ad53-cd8efbad4017" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:43:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5cc5accc-7d25-4516-9855-59bd1c0de700 tempest-AttachVolumeTestJSON-426441744 None] Lock "cinder-quobyte-53a380ec-b24d-4a5f-ad53-cd8efbad4017" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:43:51 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1a0c5b-419b-48a5-95de-14b96e58886f]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:43:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5cc5accc-7d25-4516-9855-59bd1c0de700 tempest-AttachVolumeTestJSON-426441744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-53a380ec-b24d-4a5f-ad53-cd8efbad4017 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:52 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-53a380ec-b24d-4a5f-ad53-cd8efbad4017 Jul 24 09:43:52 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:52 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5cc5accc-7d25-4516-9855-59bd1c0de700 tempest-AttachVolumeTestJSON-426441744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-53a380ec-b24d-4a5f-ad53-cd8efbad4017" returned: 0 in 0.953s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5cc5accc-7d25-4516-9855-59bd1c0de700 tempest-AttachVolumeTestJSON-426441744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-53a380ec-b24d-4a5f-ad53-cd8efbad4017 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:52 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:43:52 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-53a380ec-b24d-4a5f-ad53-cd8efbad4017 Jul 24 09:43:52 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Flow 'volume_create_manager' (a30fcd59-a81b-47b1-92ff-71ef86ce6ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3861a2ce-c381-48fc-b384-dffbe2304b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3861a2ce-c381-48fc-b384-dffbe2304b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1765627225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b509e4-a0ba-4a90-9536-15f774ffca9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='591d01709d2d4f2b8ae6f26e2669cc8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:53Z,use_quota=True,user_id='b7f75132d67c4fa6a314d26599aa943d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b4c6ff-8c1c-4336-8d80-98a3b2681b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b4c6ff-8c1c-4336-8d80-98a3b2681b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f2ed1f-d0a5-4310-8e51-046d58f503ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f2ed1f-d0a5-4310-8e51-046d58f503ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88b509e4-a0ba-4a90-9536-15f774ffca9f', 'volume_name': 'volume-88b509e4-a0ba-4a90-9536-15f774ffca9f', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6c080f-ab73-438f-8ae6-20bfa80c73a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6c080f-ab73-438f-8ae6-20bfa80c73a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac61e38-581e-4ff8-9a63-bf497e4266a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:53 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Volume 88b509e4-a0ba-4a90-9536-15f774ffca9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88b509e4-a0ba-4a90-9536-15f774ffca9f', 'volume_size': 1} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1765627225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b509e4-a0ba-4a90-9536-15f774ffca9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='591d01709d2d4f2b8ae6f26e2669cc8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:43:53Z,use_quota=True,user_id='b7f75132d67c4fa6a314d26599aa943d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Creating volume 88b509e4-a0ba-4a90-9536-15f774ffca9f {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:43:53 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:53 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f 1073741824 Jul 24 09:43:53 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:53 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5cc5accc-7d25-4516-9855-59bd1c0de700 tempest-AttachVolumeTestJSON-426441744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-53a380ec-b24d-4a5f-ad53-cd8efbad4017" returned: 0 in 0.392s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5cc5accc-7d25-4516-9855-59bd1c0de700 tempest-AttachVolumeTestJSON-426441744 None] Lock "cinder-quobyte-53a380ec-b24d-4a5f-ad53-cd8efbad4017" released by "delete_volume" :: held 1.402s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-5cc5accc-7d25-4516-9855-59bd1c0de700 tempest-AttachVolumeTestJSON-426441744 None] Created reservations ['f7915349-f105-4bdc-bb10-da675167428f', 'ddd9ed41-b9f3-4e3e-9326-ccbc23d8aa96', '3ca979de-7209-4ccf-bf40-79125d849301', 'd11199a8-4dcf-4ea5-80a7-6f085b67adfe'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5cc5accc-7d25-4516-9855-59bd1c0de700 tempest-AttachVolumeTestJSON-426441744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5cc5accc-7d25-4516-9855-59bd1c0de700 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-5cc5accc-7d25-4516-9855-59bd1c0de700 tempest-AttachVolumeTestJSON-426441744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-5cc5accc-7d25-4516-9855-59bd1c0de700 tempest-AttachVolumeTestJSON-426441744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5cc5accc-7d25-4516-9855-59bd1c0de700 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5cc5accc-7d25-4516-9855-59bd1c0de700 tempest-AttachVolumeTestJSON-426441744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:53 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:43:53 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:53 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f 1073741824" returned: 0 in 0.653s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:53 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5cc5accc-7d25-4516-9855-59bd1c0de700 tempest-AttachVolumeTestJSON-426441744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.410s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-5cc5accc-7d25-4516-9855-59bd1c0de700 tempest-AttachVolumeTestJSON-426441744 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:53 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-5cc5accc-7d25-4516-9855-59bd1c0de700 tempest-AttachVolumeTestJSON-426441744 None] Deleted volume successfully. Jul 24 09:43:53 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f Jul 24 09:43:53 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5cc5accc-7d25-4516-9855-59bd1c0de700 tempest-AttachVolumeTestJSON-426441744 None] Lock "cinder-53a380ec-b24d-4a5f-ad53-cd8efbad4017-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:43:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a16ae60c-1208-4385-95a2-8b128bd59751 tempest-AttachVolumeTestJSON-426441744 None] Acquiring lock "cinder-e324cfe9-c820-49b5-988d-04571621357b-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:43:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a16ae60c-1208-4385-95a2-8b128bd59751 tempest-AttachVolumeTestJSON-426441744 None] Lock "cinder-e324cfe9-c820-49b5-988d-04571621357b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:43:54 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f" returned: 0 in 0.333s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:43:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a16ae60c-1208-4385-95a2-8b128bd59751 tempest-AttachVolumeTestJSON-426441744 None] Acquiring lock "cinder-quobyte-e324cfe9-c820-49b5-988d-04571621357b" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:43:54 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac61e38-581e-4ff8-9a63-bf497e4266a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88b509e4-a0ba-4a90-9536-15f774ffca9f', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:54 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80984921-044f-45ab-9cba-f6eb8f8af61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a16ae60c-1208-4385-95a2-8b128bd59751 tempest-AttachVolumeTestJSON-426441744 None] Lock "cinder-quobyte-e324cfe9-c820-49b5-988d-04571621357b" acquired by "delete_volume" :: waited 0.072s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:43:54 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Volume volume-88b509e4-a0ba-4a90-9536-15f774ffca9f (88b509e4-a0ba-4a90-9536-15f774ffca9f): created successfully Jul 24 09:43:54 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80984921-044f-45ab-9cba-f6eb8f8af61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:54 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Flow 'volume_create_manager' (a30fcd59-a81b-47b1-92ff-71ef86ce6ffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:54 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00d1b77-ae69-4cdf-8ec6-9bb4d0e32a51]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:43:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a16ae60c-1208-4385-95a2-8b128bd59751 tempest-AttachVolumeTestJSON-426441744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e324cfe9-c820-49b5-988d-04571621357b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:54 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-3bb8875b-5d87-4301-893d-d18bd640934a tempest-VolumesActionsTest-284469595 None] Created volume successfully. Jul 24 09:43:54 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e324cfe9-c820-49b5-988d-04571621357b Jul 24 09:43:54 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:54 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a16ae60c-1208-4385-95a2-8b128bd59751 tempest-AttachVolumeTestJSON-426441744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e324cfe9-c820-49b5-988d-04571621357b" returned: 0 in 0.404s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a16ae60c-1208-4385-95a2-8b128bd59751 tempest-AttachVolumeTestJSON-426441744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e324cfe9-c820-49b5-988d-04571621357b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:54 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e324cfe9-c820-49b5-988d-04571621357b Jul 24 09:43:54 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:54 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a16ae60c-1208-4385-95a2-8b128bd59751 tempest-AttachVolumeTestJSON-426441744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e324cfe9-c820-49b5-988d-04571621357b" returned: 0 in 0.325s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:55 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a16ae60c-1208-4385-95a2-8b128bd59751 tempest-AttachVolumeTestJSON-426441744 None] Lock "cinder-quobyte-e324cfe9-c820-49b5-988d-04571621357b" released by "delete_volume" :: held 0.822s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:43:55 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-a16ae60c-1208-4385-95a2-8b128bd59751 tempest-AttachVolumeTestJSON-426441744 None] Created reservations ['7ae03d85-eed4-4ddc-8d75-b89d10f0c4d5', '8530551d-c7f5-44fc-bbe7-7bd4bee70df0', 'b53a1a00-adf1-478f-b9d9-83b6ad3aef52', '7acd4976-31be-4c52-b440-f2d96689abdf'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:43:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a16ae60c-1208-4385-95a2-8b128bd59751 tempest-AttachVolumeTestJSON-426441744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a16ae60c-1208-4385-95a2-8b128bd59751 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a16ae60c-1208-4385-95a2-8b128bd59751 tempest-AttachVolumeTestJSON-426441744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a16ae60c-1208-4385-95a2-8b128bd59751 tempest-AttachVolumeTestJSON-426441744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a16ae60c-1208-4385-95a2-8b128bd59751 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a16ae60c-1208-4385-95a2-8b128bd59751 tempest-AttachVolumeTestJSON-426441744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:55 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:43:55 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:55 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c750edec-e269-4f7b-9264-2a8705a02e59 tempest-AttachVolumeTestJSON-426441744 None] Acquiring lock "cinder-e0018555-3be2-432b-b345-b60cb7587cf8-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:43:55 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c750edec-e269-4f7b-9264-2a8705a02e59 tempest-AttachVolumeTestJSON-426441744 None] Lock "cinder-e0018555-3be2-432b-b345-b60cb7587cf8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:43:55 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c750edec-e269-4f7b-9264-2a8705a02e59 tempest-AttachVolumeTestJSON-426441744 None] Acquiring lock "cinder-quobyte-e0018555-3be2-432b-b345-b60cb7587cf8" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:43:55 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:55 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c750edec-e269-4f7b-9264-2a8705a02e59 tempest-AttachVolumeTestJSON-426441744 None] Lock "cinder-quobyte-e0018555-3be2-432b-b345-b60cb7587cf8" acquired by "delete_volume" :: waited 0.024s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:43:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a16ae60c-1208-4385-95a2-8b128bd59751 tempest-AttachVolumeTestJSON-426441744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.430s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:55 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-a16ae60c-1208-4385-95a2-8b128bd59751 tempest-AttachVolumeTestJSON-426441744 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:43:55 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-a16ae60c-1208-4385-95a2-8b128bd59751 tempest-AttachVolumeTestJSON-426441744 None] Deleted volume successfully. Jul 24 09:43:55 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1e5c20-0737-49c9-9fbd-8297495c26af]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:43:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c750edec-e269-4f7b-9264-2a8705a02e59 tempest-AttachVolumeTestJSON-426441744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e0018555-3be2-432b-b345-b60cb7587cf8 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:55 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a16ae60c-1208-4385-95a2-8b128bd59751 tempest-AttachVolumeTestJSON-426441744 None] Lock "cinder-e324cfe9-c820-49b5-988d-04571621357b-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:43:55 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e0018555-3be2-432b-b345-b60cb7587cf8 Jul 24 09:43:55 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:56 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c750edec-e269-4f7b-9264-2a8705a02e59 tempest-AttachVolumeTestJSON-426441744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e0018555-3be2-432b-b345-b60cb7587cf8" returned: 0 in 0.562s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c750edec-e269-4f7b-9264-2a8705a02e59 tempest-AttachVolumeTestJSON-426441744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e0018555-3be2-432b-b345-b60cb7587cf8 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:56 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e0018555-3be2-432b-b345-b60cb7587cf8 Jul 24 09:43:56 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:56 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c750edec-e269-4f7b-9264-2a8705a02e59 tempest-AttachVolumeTestJSON-426441744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e0018555-3be2-432b-b345-b60cb7587cf8" returned: 0 in 0.314s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c750edec-e269-4f7b-9264-2a8705a02e59 tempest-AttachVolumeTestJSON-426441744 None] Lock "cinder-quobyte-e0018555-3be2-432b-b345-b60cb7587cf8" released by "delete_volume" :: held 0.956s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:43:56 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-c750edec-e269-4f7b-9264-2a8705a02e59 tempest-AttachVolumeTestJSON-426441744 None] Created reservations ['b539b0db-d87f-4962-b93d-dd072e9ff1d2', '1dca9dc1-eb2d-4226-a9f5-499af007c24c', '1141e8ad-ff58-41e8-9715-39ab8ce19775', 'c94c96d7-d354-4433-bdeb-0f93a0c95f52'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:43:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c750edec-e269-4f7b-9264-2a8705a02e59 tempest-AttachVolumeTestJSON-426441744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c750edec-e269-4f7b-9264-2a8705a02e59 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c750edec-e269-4f7b-9264-2a8705a02e59 tempest-AttachVolumeTestJSON-426441744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c750edec-e269-4f7b-9264-2a8705a02e59 tempest-AttachVolumeTestJSON-426441744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c750edec-e269-4f7b-9264-2a8705a02e59 tempest-AttachVolumeTestJSON-426441744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c750edec-e269-4f7b-9264-2a8705a02e59 tempest-AttachVolumeTestJSON-426441744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:43:56 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:43:56 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:43:56 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Jul 24 09:43:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c750edec-e269-4f7b-9264-2a8705a02e59 tempest-AttachVolumeTestJSON-426441744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.279s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:43:56 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-c750edec-e269-4f7b-9264-2a8705a02e59 tempest-AttachVolumeTestJSON-426441744 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:43:57 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c750edec-e269-4f7b-9264-2a8705a02e59 tempest-AttachVolumeTestJSON-426441744 None] Deleted volume successfully. Jul 24 09:43:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c750edec-e269-4f7b-9264-2a8705a02e59 tempest-AttachVolumeTestJSON-426441744 None] Lock "cinder-e0018555-3be2-432b-b345-b60cb7587cf8-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Flow 'volume_create_manager' (82216f87-31bb-45c1-b6bd-0794bb4a5020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8e6632-9261-4343-9811-47169733e0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8e6632-9261-4343-9811-47169733e0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1055694471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e1a3b1-d8df-4a66-baf9-ae6774d0de16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1e8728dbe14e0895edb2f88cb0fc3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:44:00Z,use_quota=True,user_id='aa82ecf6ceaf47b7ad274c45c2e6469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97730dc-483b-48f4-b3dc-431f8d95fb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97730dc-483b-48f4-b3dc-431f8d95fb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5eaa6fd-3650-4070-9fe2-d4cf1b1a1bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5eaa6fd-3650-4070-9fe2-d4cf1b1a1bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e1a3b1-d8df-4a66-baf9-ae6774d0de16', 'volume_name': 'volume-65e1a3b1-d8df-4a66-baf9-ae6774d0de16', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b97cff95-b014-4d0d-a190-f0865889f758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b97cff95-b014-4d0d-a190-f0865889f758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64cc242-047c-4212-b51c-3b5c1a01330a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:43:59 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Volume 65e1a3b1-d8df-4a66-baf9-ae6774d0de16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e1a3b1-d8df-4a66-baf9-ae6774d0de16', 'volume_size': 1} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1055694471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e1a3b1-d8df-4a66-baf9-ae6774d0de16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1e8728dbe14e0895edb2f88cb0fc3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:44:00Z,use_quota=True,user_id='aa82ecf6ceaf47b7ad274c45c2e6469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Creating volume 65e1a3b1-d8df-4a66-baf9-ae6774d0de16 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:43:59 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:43:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-65e1a3b1-d8df-4a66-baf9-ae6774d0de16 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:00 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-65e1a3b1-d8df-4a66-baf9-ae6774d0de16 1073741824 Jul 24 09:44:00 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:00 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-65e1a3b1-d8df-4a66-baf9-ae6774d0de16 1073741824" returned: 0 in 0.685s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-65e1a3b1-d8df-4a66-baf9-ae6774d0de16 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:00 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-65e1a3b1-d8df-4a66-baf9-ae6774d0de16 Jul 24 09:44:00 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:01 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-65e1a3b1-d8df-4a66-baf9-ae6774d0de16" returned: 0 in 0.615s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:44:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:44:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64cc242-047c-4212-b51c-3b5c1a01330a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e1a3b1-d8df-4a66-baf9-ae6774d0de16', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9041992d-260b-43e6-bfdf-bfbd34425934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:01 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Volume volume-65e1a3b1-d8df-4a66-baf9-ae6774d0de16 (65e1a3b1-d8df-4a66-baf9-ae6774d0de16): created successfully Jul 24 09:44:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9041992d-260b-43e6-bfdf-bfbd34425934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Flow 'volume_create_manager' (82216f87-31bb-45c1-b6bd-0794bb4a5020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:44:01 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e9bb7625-4245-4944-9d0d-b9cbf477784a tempest-VolumesServicesTestJSON-97386363 None] Created volume successfully. Jul 24 09:44:02 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e7bf7a37-2d95-4769-b207-44a18a6702ab tempest-VolumesServicesTestJSON-97386363 None] Acquiring lock "cinder-65e1a3b1-d8df-4a66-baf9-ae6774d0de16-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:44:02 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e7bf7a37-2d95-4769-b207-44a18a6702ab tempest-VolumesServicesTestJSON-97386363 None] Lock "cinder-65e1a3b1-d8df-4a66-baf9-ae6774d0de16-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:44:02 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e7bf7a37-2d95-4769-b207-44a18a6702ab tempest-VolumesServicesTestJSON-97386363 None] Acquiring lock "cinder-quobyte-65e1a3b1-d8df-4a66-baf9-ae6774d0de16" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:44:02 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e7bf7a37-2d95-4769-b207-44a18a6702ab tempest-VolumesServicesTestJSON-97386363 None] Lock "cinder-quobyte-65e1a3b1-d8df-4a66-baf9-ae6774d0de16" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:44:02 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d02031-1709-417e-8800-fa3f433abb3d]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:44:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e7bf7a37-2d95-4769-b207-44a18a6702ab tempest-VolumesServicesTestJSON-97386363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-65e1a3b1-d8df-4a66-baf9-ae6774d0de16 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:02 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-65e1a3b1-d8df-4a66-baf9-ae6774d0de16 Jul 24 09:44:02 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:03 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e7bf7a37-2d95-4769-b207-44a18a6702ab tempest-VolumesServicesTestJSON-97386363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-65e1a3b1-d8df-4a66-baf9-ae6774d0de16" returned: 0 in 0.612s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e7bf7a37-2d95-4769-b207-44a18a6702ab tempest-VolumesServicesTestJSON-97386363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-65e1a3b1-d8df-4a66-baf9-ae6774d0de16 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:03 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-65e1a3b1-d8df-4a66-baf9-ae6774d0de16 Jul 24 09:44:03 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:03 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e7bf7a37-2d95-4769-b207-44a18a6702ab tempest-VolumesServicesTestJSON-97386363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-65e1a3b1-d8df-4a66-baf9-ae6774d0de16" returned: 0 in 0.575s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e7bf7a37-2d95-4769-b207-44a18a6702ab tempest-VolumesServicesTestJSON-97386363 None] Lock "cinder-quobyte-65e1a3b1-d8df-4a66-baf9-ae6774d0de16" released by "delete_volume" :: held 1.270s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:44:03 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-e7bf7a37-2d95-4769-b207-44a18a6702ab tempest-VolumesServicesTestJSON-97386363 None] Created reservations ['4412b856-5a35-48db-8b48-980e65a59b72', 'd0933c06-ae6a-42b2-b973-e64fd4cd32a4', '86850000-f821-4528-813a-3486e772dde4', '3f329b75-5bff-4303-ad4f-3c6980d8dde0'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:44:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e7bf7a37-2d95-4769-b207-44a18a6702ab tempest-VolumesServicesTestJSON-97386363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:44:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e7bf7a37-2d95-4769-b207-44a18a6702ab tempest-VolumesServicesTestJSON-97386363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:44:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e7bf7a37-2d95-4769-b207-44a18a6702ab tempest-VolumesServicesTestJSON-97386363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:44:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e7bf7a37-2d95-4769-b207-44a18a6702ab tempest-VolumesServicesTestJSON-97386363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:44:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e7bf7a37-2d95-4769-b207-44a18a6702ab tempest-VolumesServicesTestJSON-97386363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:44:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e7bf7a37-2d95-4769-b207-44a18a6702ab tempest-VolumesServicesTestJSON-97386363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:04 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:44:04 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:04 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e7bf7a37-2d95-4769-b207-44a18a6702ab tempest-VolumesServicesTestJSON-97386363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.393s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:04 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-e7bf7a37-2d95-4769-b207-44a18a6702ab tempest-VolumesServicesTestJSON-97386363 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:44:04 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e7bf7a37-2d95-4769-b207-44a18a6702ab tempest-VolumesServicesTestJSON-97386363 None] Deleted volume successfully. Jul 24 09:44:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e7bf7a37-2d95-4769-b207-44a18a6702ab tempest-VolumesServicesTestJSON-97386363 None] Lock "cinder-65e1a3b1-d8df-4a66-baf9-ae6774d0de16-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:44:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f6cb537b-dcda-4be1-b43d-82b1ad0e2762 tempest-VolumesActionsTest-284469595 None] Acquiring lock "cinder-88b509e4-a0ba-4a90-9536-15f774ffca9f" by "attach_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:44:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f6cb537b-dcda-4be1-b43d-82b1ad0e2762 tempest-VolumesActionsTest-284469595 None] Lock "cinder-88b509e4-a0ba-4a90-9536-15f774ffca9f" acquired by "attach_volume" :: waited 0.046s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:44:04 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-f6cb537b-dcda-4be1-b43d-82b1ad0e2762 tempest-VolumesActionsTest-284469595 None] Attaching volume 88b509e4-a0ba-4a90-9536-15f774ffca9f to instance a23ef188-b94e-4d62-a075-42cc64039c6c at mountpoint /dev/vdb on host None. Jul 24 09:44:04 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-f6cb537b-dcda-4be1-b43d-82b1ad0e2762 tempest-VolumesActionsTest-284469595 None] Attach volume completed successfully. Jul 24 09:44:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f6cb537b-dcda-4be1-b43d-82b1ad0e2762 tempest-VolumesActionsTest-284469595 None] Lock "cinder-88b509e4-a0ba-4a90-9536-15f774ffca9f" released by "attach_volume" :: held 0.178s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:44:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-202d179c-ae92-4244-a70e-cd1456ad6691 tempest-VolumesActionsTest-284469595 None] Acquiring lock "cinder-88b509e4-a0ba-4a90-9536-15f774ffca9f-detach_volume" by "detach_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:44:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-202d179c-ae92-4244-a70e-cd1456ad6691 tempest-VolumesActionsTest-284469595 None] Lock "cinder-88b509e4-a0ba-4a90-9536-15f774ffca9f-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:44:05 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-202d179c-ae92-4244-a70e-cd1456ad6691 tempest-VolumesActionsTest-284469595 None] Detaching volume 88b509e4-a0ba-4a90-9536-15f774ffca9f from instance a23ef188-b94e-4d62-a075-42cc64039c6c. Jul 24 09:44:05 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-202d179c-ae92-4244-a70e-cd1456ad6691 tempest-VolumesActionsTest-284469595 None] Detach volume completed successfully. Jul 24 09:44:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-202d179c-ae92-4244-a70e-cd1456ad6691 tempest-VolumesActionsTest-284469595 None] Lock "cinder-88b509e4-a0ba-4a90-9536-15f774ffca9f-detach_volume" released by "detach_volume" :: held 0.127s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:44:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-ad6f1a9d-a295-4487-bdde-169a23e7d893 req-fe7feb5c-8718-4b55-ab82-4c94c0f393ca tempest-TestInstancesWithCinderVolumes-793657892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:44:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-ad6f1a9d-a295-4487-bdde-169a23e7d893 req-fe7feb5c-8718-4b55-ab82-4c94c0f393ca tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:44:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-ad6f1a9d-a295-4487-bdde-169a23e7d893 req-fe7feb5c-8718-4b55-ab82-4c94c0f393ca tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:44:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-ad6f1a9d-a295-4487-bdde-169a23e7d893 req-fe7feb5c-8718-4b55-ab82-4c94c0f393ca tempest-TestInstancesWithCinderVolumes-793657892 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-54fbf4f5-bcc8-4def-bf67-918fa6759b5f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6efd7906-b1b5-4f3c-8d36-d7f2997d8a0a', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:44:08 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-ad6f1a9d-a295-4487-bdde-169a23e7d893 req-fe7feb5c-8718-4b55-ab82-4c94c0f393ca tempest-TestInstancesWithCinderVolumes-793657892 None] attachment_update completed successfully. Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Flow 'volume_create_manager' (0c6518ab-5177-434b-b715-e08afee38bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5199dbe6-ffd4-4526-b846-24e7c4a10f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5199dbe6-ffd4-4526-b846-24e7c4a10f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-50761500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df203cc5-9013-41be-8059-c633247ffb15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9325f95f49b45cc8de37e7660b9ce08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:44:09Z,use_quota=True,user_id='9a38906b54874dffb5ed183433faeea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebddbca9-d3c2-48e7-8c4c-ab2ca770c8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebddbca9-d3c2-48e7-8c4c-ab2ca770c8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b91124-ecb8-4ad6-b138-8c41c44afc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b91124-ecb8-4ad6-b138-8c41c44afc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df203cc5-9013-41be-8059-c633247ffb15', 'volume_name': 'volume-df203cc5-9013-41be-8059-c633247ffb15', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9e99f1-8248-46a6-aab4-521f63150108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9e99f1-8248-46a6-aab4-521f63150108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc7035d-3a21-426f-af9d-18a0684cbea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:09 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Volume df203cc5-9013-41be-8059-c633247ffb15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df203cc5-9013-41be-8059-c633247ffb15', 'volume_size': 1} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-50761500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df203cc5-9013-41be-8059-c633247ffb15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9325f95f49b45cc8de37e7660b9ce08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:44:09Z,use_quota=True,user_id='9a38906b54874dffb5ed183433faeea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Creating volume df203cc5-9013-41be-8059-c633247ffb15 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:44:09 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df203cc5-9013-41be-8059-c633247ffb15 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:09 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df203cc5-9013-41be-8059-c633247ffb15 1073741824 Jul 24 09:44:09 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:09 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df203cc5-9013-41be-8059-c633247ffb15 1073741824" returned: 0 in 0.484s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df203cc5-9013-41be-8059-c633247ffb15 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:09 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df203cc5-9013-41be-8059-c633247ffb15 Jul 24 09:44:09 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:10 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df203cc5-9013-41be-8059-c633247ffb15" returned: 0 in 0.292s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:44:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:44:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc7035d-3a21-426f-af9d-18a0684cbea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df203cc5-9013-41be-8059-c633247ffb15', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df02fa45-bc79-49bd-bd61-f80646b4bcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:10 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Volume volume-df203cc5-9013-41be-8059-c633247ffb15 (df203cc5-9013-41be-8059-c633247ffb15): created successfully Jul 24 09:44:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df02fa45-bc79-49bd-bd61-f80646b4bcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Flow 'volume_create_manager' (0c6518ab-5177-434b-b715-e08afee38bdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:44:10 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-ff6d993e-f1ff-4360-b6b4-dc7281914e3d req-cea4ca3b-ed3f-4b41-b807-997db1ada99b tempest-VolumesGetTestJSON-2131783282 None] Created volume successfully. Jul 24 09:44:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-95825505-1bc1-4005-add3-feb1d35175ea req-30631e86-0e88-4ba1-abff-54271367cb91 tempest-TestInstancesWithCinderVolumes-793657892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:44:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-95825505-1bc1-4005-add3-feb1d35175ea req-30631e86-0e88-4ba1-abff-54271367cb91 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:44:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-95825505-1bc1-4005-add3-feb1d35175ea req-30631e86-0e88-4ba1-abff-54271367cb91 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.084s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:44:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-95825505-1bc1-4005-add3-feb1d35175ea req-30631e86-0e88-4ba1-abff-54271367cb91 tempest-TestInstancesWithCinderVolumes-793657892 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-3c30b272-1c43-4e7d-a460-36ab50e3a5db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1564d1fa-f3ec-47f7-ade8-fbd60e399306', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:44:11 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-95825505-1bc1-4005-add3-feb1d35175ea req-30631e86-0e88-4ba1-abff-54271367cb91 tempest-TestInstancesWithCinderVolumes-793657892 None] attachment_update completed successfully. Jul 24 09:44:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-d245a957-2ff4-4320-b118-4bdd2881269d req-434e2620-f5d3-4638-b4e8-d3d60a07d031 tempest-VolumesGetTestJSON-2131783282 None] Acquiring lock "cinder-df203cc5-9013-41be-8059-c633247ffb15-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:44:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-d245a957-2ff4-4320-b118-4bdd2881269d req-434e2620-f5d3-4638-b4e8-d3d60a07d031 tempest-VolumesGetTestJSON-2131783282 None] Lock "cinder-df203cc5-9013-41be-8059-c633247ffb15-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:44:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-d245a957-2ff4-4320-b118-4bdd2881269d req-434e2620-f5d3-4638-b4e8-d3d60a07d031 tempest-VolumesGetTestJSON-2131783282 None] Acquiring lock "cinder-quobyte-df203cc5-9013-41be-8059-c633247ffb15" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:44:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-d245a957-2ff4-4320-b118-4bdd2881269d req-434e2620-f5d3-4638-b4e8-d3d60a07d031 tempest-VolumesGetTestJSON-2131783282 None] Lock "cinder-quobyte-df203cc5-9013-41be-8059-c633247ffb15" acquired by "delete_volume" :: waited 0.048s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:44:12 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[85da825d-11de-42a7-9700-cf304b22a6d4]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:44:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-d245a957-2ff4-4320-b118-4bdd2881269d req-434e2620-f5d3-4638-b4e8-d3d60a07d031 tempest-VolumesGetTestJSON-2131783282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df203cc5-9013-41be-8059-c633247ffb15 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:12 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df203cc5-9013-41be-8059-c633247ffb15 Jul 24 09:44:12 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:12 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-d245a957-2ff4-4320-b118-4bdd2881269d req-434e2620-f5d3-4638-b4e8-d3d60a07d031 tempest-VolumesGetTestJSON-2131783282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df203cc5-9013-41be-8059-c633247ffb15" returned: 0 in 0.529s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-d245a957-2ff4-4320-b118-4bdd2881269d req-434e2620-f5d3-4638-b4e8-d3d60a07d031 tempest-VolumesGetTestJSON-2131783282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df203cc5-9013-41be-8059-c633247ffb15 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:12 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df203cc5-9013-41be-8059-c633247ffb15 Jul 24 09:44:12 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:13 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-d245a957-2ff4-4320-b118-4bdd2881269d req-434e2620-f5d3-4638-b4e8-d3d60a07d031 tempest-VolumesGetTestJSON-2131783282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df203cc5-9013-41be-8059-c633247ffb15" returned: 0 in 0.524s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-d245a957-2ff4-4320-b118-4bdd2881269d req-434e2620-f5d3-4638-b4e8-d3d60a07d031 tempest-VolumesGetTestJSON-2131783282 None] Lock "cinder-quobyte-df203cc5-9013-41be-8059-c633247ffb15" released by "delete_volume" :: held 1.133s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:44:13 devstack cinder-volume[88488]: DEBUG cinder.quota [req-d245a957-2ff4-4320-b118-4bdd2881269d req-434e2620-f5d3-4638-b4e8-d3d60a07d031 tempest-VolumesGetTestJSON-2131783282 None] Created reservations ['3785df1f-e048-46a2-ab90-df905b57fc35', 'f03a7cf3-aafc-46fd-a3aa-5107701afe24', 'd8977abd-e242-416f-8fcb-cde5b778f3c9', 'a7cf445c-a910-4c76-a28d-7dfabb2479f7'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:44:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-d245a957-2ff4-4320-b118-4bdd2881269d req-434e2620-f5d3-4638-b4e8-d3d60a07d031 tempest-VolumesGetTestJSON-2131783282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:44:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-d245a957-2ff4-4320-b118-4bdd2881269d req-434e2620-f5d3-4638-b4e8-d3d60a07d031 tempest-VolumesGetTestJSON-2131783282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:44:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [req-d245a957-2ff4-4320-b118-4bdd2881269d req-434e2620-f5d3-4638-b4e8-d3d60a07d031 tempest-VolumesGetTestJSON-2131783282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:44:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [req-d245a957-2ff4-4320-b118-4bdd2881269d req-434e2620-f5d3-4638-b4e8-d3d60a07d031 tempest-VolumesGetTestJSON-2131783282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:44:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-d245a957-2ff4-4320-b118-4bdd2881269d req-434e2620-f5d3-4638-b4e8-d3d60a07d031 tempest-VolumesGetTestJSON-2131783282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:44:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-d245a957-2ff4-4320-b118-4bdd2881269d req-434e2620-f5d3-4638-b4e8-d3d60a07d031 tempest-VolumesGetTestJSON-2131783282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:13 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:44:13 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:13 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-d245a957-2ff4-4320-b118-4bdd2881269d req-434e2620-f5d3-4638-b4e8-d3d60a07d031 tempest-VolumesGetTestJSON-2131783282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.336s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:13 devstack cinder-volume[88488]: DEBUG cinder.manager [req-d245a957-2ff4-4320-b118-4bdd2881269d req-434e2620-f5d3-4638-b4e8-d3d60a07d031 tempest-VolumesGetTestJSON-2131783282 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:44:13 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-d245a957-2ff4-4320-b118-4bdd2881269d req-434e2620-f5d3-4638-b4e8-d3d60a07d031 tempest-VolumesGetTestJSON-2131783282 None] Deleted volume successfully. Jul 24 09:44:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-d245a957-2ff4-4320-b118-4bdd2881269d req-434e2620-f5d3-4638-b4e8-d3d60a07d031 tempest-VolumesGetTestJSON-2131783282 None] Lock "cinder-df203cc5-9013-41be-8059-c633247ffb15-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:44:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:44:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:44:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:44:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:44:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:44:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:44:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:15 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:44:15 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:15 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.341s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:44:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:44:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 28 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:44:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:44:18 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-1693303d-2bb9-46ac-9873-ce9cbf0d02ba req-8bf0cbe5-168c-4378-8a67-9a67d95c9871 tempest-TestInstancesWithCinderVolumes-793657892 None] Terminate volume connection completed successfully. Jul 24 09:44:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-1693303d-2bb9-46ac-9873-ce9cbf0d02ba req-8bf0cbe5-168c-4378-8a67-9a67d95c9871 tempest-TestInstancesWithCinderVolumes-793657892 None] Deleting attachment 6efd7906-b1b5-4f3c-8d36-d7f2997d8a0a. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:44:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-31a0055f-83e5-4c2e-b086-21afaf94d0ea tempest-VolumesActionsTest-284469595 None] Acquiring lock "cinder-88b509e4-a0ba-4a90-9536-15f774ffca9f" by "attach_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:44:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-31a0055f-83e5-4c2e-b086-21afaf94d0ea tempest-VolumesActionsTest-284469595 None] Lock "cinder-88b509e4-a0ba-4a90-9536-15f774ffca9f" acquired by "attach_volume" :: waited 0.032s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:44:20 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-31a0055f-83e5-4c2e-b086-21afaf94d0ea tempest-VolumesActionsTest-284469595 None] Attaching volume 88b509e4-a0ba-4a90-9536-15f774ffca9f to instance 7c444105-97a6-419a-806a-3e216f3e5626 at mountpoint /dev/vdb on host None. Jul 24 09:44:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] Acquiring lock "cinder-54fbf4f5-bcc8-4def-bf67-918fa6759b5f-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:44:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "cinder-54fbf4f5-bcc8-4def-bf67-918fa6759b5f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:44:20 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-31a0055f-83e5-4c2e-b086-21afaf94d0ea tempest-VolumesActionsTest-284469595 None] Attach volume completed successfully. Jul 24 09:44:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-31a0055f-83e5-4c2e-b086-21afaf94d0ea tempest-VolumesActionsTest-284469595 None] Lock "cinder-88b509e4-a0ba-4a90-9536-15f774ffca9f" released by "attach_volume" :: held 0.174s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:44:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] Acquiring lock "cinder-quobyte-54fbf4f5-bcc8-4def-bf67-918fa6759b5f" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:44:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "cinder-quobyte-54fbf4f5-bcc8-4def-bf67-918fa6759b5f" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:44:20 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e719938f-a9a5-4947-8ddd-a8b8d8037aa9]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:44:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54fbf4f5-bcc8-4def-bf67-918fa6759b5f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:20 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54fbf4f5-bcc8-4def-bf67-918fa6759b5f Jul 24 09:44:20 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d510870c-31ca-4f66-b8c4-244aaa7c1c6b tempest-VolumesActionsTest-284469595 None] Acquiring lock "cinder-88b509e4-a0ba-4a90-9536-15f774ffca9f-detach_volume" by "detach_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:44:21 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d510870c-31ca-4f66-b8c4-244aaa7c1c6b tempest-VolumesActionsTest-284469595 None] Lock "cinder-88b509e4-a0ba-4a90-9536-15f774ffca9f-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:44:21 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d510870c-31ca-4f66-b8c4-244aaa7c1c6b tempest-VolumesActionsTest-284469595 None] Detaching volume 88b509e4-a0ba-4a90-9536-15f774ffca9f from instance 7c444105-97a6-419a-806a-3e216f3e5626. Jul 24 09:44:21 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d510870c-31ca-4f66-b8c4-244aaa7c1c6b tempest-VolumesActionsTest-284469595 None] Detach volume completed successfully. Jul 24 09:44:21 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d510870c-31ca-4f66-b8c4-244aaa7c1c6b tempest-VolumesActionsTest-284469595 None] Lock "cinder-88b509e4-a0ba-4a90-9536-15f774ffca9f-detach_volume" released by "detach_volume" :: held 0.214s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:44:21 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54fbf4f5-bcc8-4def-bf67-918fa6759b5f" returned: 0 in 0.757s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54fbf4f5-bcc8-4def-bf67-918fa6759b5f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:21 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54fbf4f5-bcc8-4def-bf67-918fa6759b5f Jul 24 09:44:21 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:21 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54fbf4f5-bcc8-4def-bf67-918fa6759b5f" returned: 0 in 0.567s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:22 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "cinder-quobyte-54fbf4f5-bcc8-4def-bf67-918fa6759b5f" released by "delete_volume" :: held 1.413s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:44:22 devstack cinder-volume[88488]: WARNING cinder.quota [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-194448196-1525425363 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-194448196-1525425363, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:44:22 devstack cinder-volume[88488]: WARNING cinder.quota [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-194448196-1525425363 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-194448196-1525425363, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:44:22 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] Created reservations ['20066568-fac0-44d5-a285-0031f127955b', '159a2b5a-921b-4e77-91ea-28cd74677124', '32478a88-205d-487b-8b17-06c34e5c427c', 'b1f41e6b-4ff6-439c-891b-200baf3eb623'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:44:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:44:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:44:22 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:44:22 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:44:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:44:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:22 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:44:22 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:22 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-61032ecb-cc19-433c-82bd-c3c6f3cae365 tempest-GroupsTest-1598942728 None] Group tempest-Group1-1511707471: creating Jul 24 09:44:22 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-61032ecb-cc19-433c-82bd-c3c6f3cae365 tempest-GroupsTest-1598942728 None] Group tempest-Group1-1511707471: created successfully Jul 24 09:44:22 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-61032ecb-cc19-433c-82bd-c3c6f3cae365 tempest-GroupsTest-1598942728 None] Create group completed successfully. Jul 24 09:44:22 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.477s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:22 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:44:22 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] Deleted volume successfully. Jul 24 09:44:22 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6e7f3f2d-20a6-4a01-b5f0-1045799fb729 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "cinder-54fbf4f5-bcc8-4def-bf67-918fa6759b5f-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Flow 'volume_create_manager' (6527225d-c1f9-43d5-ae16-6b80922f8392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9384ce5a-8d7b-462a-8643-8f78ce75ff56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9384ce5a-8d7b-462a-8643-8f78ce75ff56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1837039831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba71c96e-cce8-4298-8459-314dc7029dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea7ef94e4c14d8e84faa4dd3e151935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:44:23Z,use_quota=True,user_id='9b00aaa77fa241eaae08fb2a895adb68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e256ecc7-d4d7-418c-bdd0-e4b98b1d7c36),volume_type_id=e256ecc7-d4d7-418c-bdd0-e4b98b1d7c36)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac40c9b-fdcd-425e-8c2b-fdc64b90fe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac40c9b-fdcd-425e-8c2b-fdc64b90fe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (810272b1-33a8-4149-b4f5-924bb3b9304d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (810272b1-33a8-4149-b4f5-924bb3b9304d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba71c96e-cce8-4298-8459-314dc7029dc1', 'volume_name': 'volume-ba71c96e-cce8-4298-8459-314dc7029dc1', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d65238-492c-4080-8431-d35ff6bab375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d65238-492c-4080-8431-d35ff6bab375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893464f8-8ff1-46bb-927d-0c89f5d37d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:23 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Volume ba71c96e-cce8-4298-8459-314dc7029dc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba71c96e-cce8-4298-8459-314dc7029dc1', 'volume_size': 1} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1837039831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba71c96e-cce8-4298-8459-314dc7029dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea7ef94e4c14d8e84faa4dd3e151935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:44:23Z,use_quota=True,user_id='9b00aaa77fa241eaae08fb2a895adb68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e256ecc7-d4d7-418c-bdd0-e4b98b1d7c36),volume_type_id=e256ecc7-d4d7-418c-bdd0-e4b98b1d7c36)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Creating volume ba71c96e-cce8-4298-8459-314dc7029dc1 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:44:23 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba71c96e-cce8-4298-8459-314dc7029dc1 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:23 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba71c96e-cce8-4298-8459-314dc7029dc1 1073741824 Jul 24 09:44:23 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:23 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e1bef728-a711-4c80-a869-f393a168ea6d tempest-GroupsTest-1598942728 None] Group tempest-Group2-527310737: creating Jul 24 09:44:23 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e1bef728-a711-4c80-a869-f393a168ea6d tempest-GroupsTest-1598942728 None] Group tempest-Group2-527310737: created successfully Jul 24 09:44:23 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e1bef728-a711-4c80-a869-f393a168ea6d tempest-GroupsTest-1598942728 None] Create group completed successfully. Jul 24 09:44:23 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba71c96e-cce8-4298-8459-314dc7029dc1 1073741824" returned: 0 in 0.675s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba71c96e-cce8-4298-8459-314dc7029dc1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:24 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba71c96e-cce8-4298-8459-314dc7029dc1 Jul 24 09:44:24 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:24 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba71c96e-cce8-4298-8459-314dc7029dc1" returned: 0 in 0.258s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:44:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:44:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893464f8-8ff1-46bb-927d-0c89f5d37d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba71c96e-cce8-4298-8459-314dc7029dc1', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3cba21-0347-4165-98a2-3412d31acb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:24 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Volume volume-ba71c96e-cce8-4298-8459-314dc7029dc1 (ba71c96e-cce8-4298-8459-314dc7029dc1): created successfully Jul 24 09:44:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3cba21-0347-4165-98a2-3412d31acb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Flow 'volume_create_manager' (6527225d-c1f9-43d5-ae16-6b80922f8392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:44:24 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e3abba42-8e92-4d67-8a06-9d3ca6b29d6e tempest-VolumeTypesAccessTest-608883172 None] Created volume successfully. Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] Acquiring lock "cinder-ba71c96e-cce8-4298-8459-314dc7029dc1-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] Lock "cinder-ba71c96e-cce8-4298-8459-314dc7029dc1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] Acquiring lock "cinder-quobyte-ba71c96e-cce8-4298-8459-314dc7029dc1" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] Lock "cinder-quobyte-ba71c96e-cce8-4298-8459-314dc7029dc1" acquired by "delete_volume" :: waited 0.021s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[196645e4-feaa-4493-bddb-3e235b986692]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba71c96e-cce8-4298-8459-314dc7029dc1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:25 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba71c96e-cce8-4298-8459-314dc7029dc1 Jul 24 09:44:25 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:25 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-28e86e04-84f3-4b03-9417-a0829a526b4c req-3c02b602-4e55-4dd7-9b98-7c4113bac866 tempest-TestInstancesWithCinderVolumes-793657892 None] Terminate volume connection completed successfully. Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-28e86e04-84f3-4b03-9417-a0829a526b4c req-3c02b602-4e55-4dd7-9b98-7c4113bac866 tempest-TestInstancesWithCinderVolumes-793657892 None] Deleting attachment 1564d1fa-f3ec-47f7-ade8-fbd60e399306. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Flow 'volume_create_manager' (675c2da5-e939-43c1-9adf-64efeb5a689a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c8e35b-45cf-4ae5-b3fe-1be3b492fbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c8e35b-45cf-4ae5-b3fe-1be3b492fbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1734450686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f3d589eb-0b7e-4f71-8aa0-9e1a961da4e9,host='devstack@QuobyteHD#QuobyteHD',id=2c292a9d-ed52-4db3-8cf5-021f9f26bdb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f1eacdeffac424bb8077b2d499be5c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:44:26Z,use_quota=True,user_id='a380d844f0a04191b4793489f3a2fbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0a3c995-e7b5-4374-8919-5676fe224ed5),volume_type_id=e0a3c995-e7b5-4374-8919-5676fe224ed5)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c5ac22-0e42-42f9-a712-bb81459df782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c5ac22-0e42-42f9-a712-bb81459df782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b546fa8-f94b-4c13-a40d-d91e18fe0201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b546fa8-f94b-4c13-a40d-d91e18fe0201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c292a9d-ed52-4db3-8cf5-021f9f26bdb5', 'volume_name': 'volume-2c292a9d-ed52-4db3-8cf5-021f9f26bdb5', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f0eba9-c4c0-4f48-abd5-b5d6ceb98f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f0eba9-c4c0-4f48-abd5-b5d6ceb98f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f372e1-ba61-47a0-ae88-74dfd535edcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:25 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Volume 2c292a9d-ed52-4db3-8cf5-021f9f26bdb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c292a9d-ed52-4db3-8cf5-021f9f26bdb5', 'volume_size': 1} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f3d589eb-0b7e-4f71-8aa0-9e1a961da4e9,created_at=2026-07-24T07:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1734450686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f3d589eb-0b7e-4f71-8aa0-9e1a961da4e9,host='devstack@QuobyteHD#QuobyteHD',id=2c292a9d-ed52-4db3-8cf5-021f9f26bdb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f1eacdeffac424bb8077b2d499be5c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:44:26Z,use_quota=True,user_id='a380d844f0a04191b4793489f3a2fbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0a3c995-e7b5-4374-8919-5676fe224ed5),volume_type_id=e0a3c995-e7b5-4374-8919-5676fe224ed5)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Creating volume 2c292a9d-ed52-4db3-8cf5-021f9f26bdb5 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:44:25 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2c292a9d-ed52-4db3-8cf5-021f9f26bdb5 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:25 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2c292a9d-ed52-4db3-8cf5-021f9f26bdb5 1073741824 Jul 24 09:44:25 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:25 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba71c96e-cce8-4298-8459-314dc7029dc1" returned: 0 in 0.467s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba71c96e-cce8-4298-8459-314dc7029dc1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:26 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba71c96e-cce8-4298-8459-314dc7029dc1 Jul 24 09:44:26 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] Acquiring lock "cinder-3c30b272-1c43-4e7d-a460-36ab50e3a5db-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "cinder-3c30b272-1c43-4e7d-a460-36ab50e3a5db-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] Acquiring lock "cinder-quobyte-3c30b272-1c43-4e7d-a460-36ab50e3a5db" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "cinder-quobyte-3c30b272-1c43-4e7d-a460-36ab50e3a5db" acquired by "delete_volume" :: waited 0.028s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb83f5d8-6caa-4011-b9ab-2b3b0510340b]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c30b272-1c43-4e7d-a460-36ab50e3a5db {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:26 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:26 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c30b272-1c43-4e7d-a460-36ab50e3a5db Jul 24 09:44:26 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba71c96e-cce8-4298-8459-314dc7029dc1" returned: 0 in 0.443s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] Lock "cinder-quobyte-ba71c96e-cce8-4298-8459-314dc7029dc1" released by "delete_volume" :: held 0.969s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:44:26 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2c292a9d-ed52-4db3-8cf5-021f9f26bdb5 1073741824" returned: 0 in 0.628s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9ba9ddb0-64ae-4b3d-b12e-bd416b289330 tempest-VolumesActionsTest-284469595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:44:26 devstack cinder-volume[88488]: WARNING cinder.quota [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1960012098 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1960012098, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:44:26 devstack cinder-volume[88488]: WARNING cinder.quota [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1960012098 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1960012098, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2c292a9d-ed52-4db3-8cf5-021f9f26bdb5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] Created reservations ['a7efe2fe-4a44-4a40-82a4-793a839023ec', '6e4465d8-4f01-42af-ab56-d34d1c8c4b2e', '7bf42d8c-c85b-4a9c-9040-28da90f397a6', '01c92066-3530-464b-8d7f-66bf5ffc9d59'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:44:26 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2c292a9d-ed52-4db3-8cf5-021f9f26bdb5 Jul 24 09:44:26 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:26 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:44:26 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:26 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c30b272-1c43-4e7d-a460-36ab50e3a5db" returned: 0 in 0.517s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c30b272-1c43-4e7d-a460-36ab50e3a5db {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:26 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c30b272-1c43-4e7d-a460-36ab50e3a5db Jul 24 09:44:26 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:26 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2c292a9d-ed52-4db3-8cf5-021f9f26bdb5" returned: 0 in 0.369s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9ba9ddb0-64ae-4b3d-b12e-bd416b289330 tempest-VolumesActionsTest-284469595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.397s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f372e1-ba61-47a0-ae88-74dfd535edcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c292a9d-ed52-4db3-8cf5-021f9f26bdb5', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958249e8-48ec-4620-b165-fa7efd4d1201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00efe53-dadd-4a56-bc36-b0ef58405170]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9ba9ddb0-64ae-4b3d-b12e-bd416b289330 tempest-VolumesActionsTest-284469595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:26 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Volume volume-2c292a9d-ed52-4db3-8cf5-021f9f26bdb5 (2c292a9d-ed52-4db3-8cf5-021f9f26bdb5): created successfully Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958249e8-48ec-4620-b165-fa7efd4d1201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Flow 'volume_create_manager' (675c2da5-e939-43c1-9adf-64efeb5a689a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:44:27 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-20e4d272-39df-4c00-9062-901425151df2 tempest-GroupsTest-1598942728 None] Created volume successfully. Jul 24 09:44:27 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.428s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:27 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:44:27 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] Deleted volume successfully. Jul 24 09:44:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-90138321-8356-48ca-8809-22cbf33e19d9 tempest-VolumeTypesAccessTest-608883172 None] Lock "cinder-ba71c96e-cce8-4298-8459-314dc7029dc1-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:44:27 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f Jul 24 09:44:27 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:27 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c30b272-1c43-4e7d-a460-36ab50e3a5db" returned: 0 in 0.449s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "cinder-quobyte-3c30b272-1c43-4e7d-a460-36ab50e3a5db" released by "delete_volume" :: held 1.022s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:44:27 devstack cinder-volume[88488]: WARNING cinder.quota [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1874116244-1951489482 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1874116244-1951489482, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:44:27 devstack cinder-volume[88488]: WARNING cinder.quota [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1874116244-1951489482 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1874116244-1951489482, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:44:27 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] Created reservations ['65636aed-3db3-4ea7-8a09-072af893233c', '739feb6f-fdfa-4404-9bcb-095ce1f804db', 'e904970a-f565-487b-9da8-debdd00f211f', 'd41e91f6-dfca-478b-9c66-ecf7c8176f70'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:44:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:44:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:44:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:44:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:44:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:44:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:27 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:44:27 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:27 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9ba9ddb0-64ae-4b3d-b12e-bd416b289330 tempest-VolumesActionsTest-284469595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f" returned: 0 in 0.566s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:27 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a7a697-e665-4ebb-8851-bbbb5887aede]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:44:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9ba9ddb0-64ae-4b3d-b12e-bd416b289330 tempest-VolumesActionsTest-284469595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:27 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f Jul 24 09:44:27 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:27 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.303s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:27 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:44:27 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] Deleted volume successfully. Jul 24 09:44:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e3e9a2b-d5eb-4e2c-af72-cbedb6de6990 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "cinder-3c30b272-1c43-4e7d-a460-36ab50e3a5db-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:44:28 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9ba9ddb0-64ae-4b3d-b12e-bd416b289330 tempest-VolumesActionsTest-284469595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f" returned: 0 in 0.502s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9ba9ddb0-64ae-4b3d-b12e-bd416b289330 tempest-VolumesActionsTest-284469595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f /opt/stack/data/cinder/conversion/88b509e4-a0ba-4a90-9536-15f774ffca9f.temp_image.241de3f8-f6ff-427d-ae5c-eee0370994d59hyx4dv0.img {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:28 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f /opt/stack/data/cinder/conversion/88b509e4-a0ba-4a90-9536-15f774ffca9f.temp_image.241de3f8-f6ff-427d-ae5c-eee0370994d59hyx4dv0.img Jul 24 09:44:28 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:29 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-46a504a4-7cc2-4984-b83e-8db2b780671b tempest-GroupsTest-1598942728 None] Acquiring lock "cinder-quobyte-2c292a9d-ed52-4db3-8cf5-021f9f26bdb5" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:44:29 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-46a504a4-7cc2-4984-b83e-8db2b780671b tempest-GroupsTest-1598942728 None] Lock "cinder-quobyte-2c292a9d-ed52-4db3-8cf5-021f9f26bdb5" acquired by "delete_volume" :: waited 0.057s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:44:29 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[65601658-1f8d-47d8-acdc-2ce7bbbf29b7]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:44:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-46a504a4-7cc2-4984-b83e-8db2b780671b tempest-GroupsTest-1598942728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2c292a9d-ed52-4db3-8cf5-021f9f26bdb5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:29 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2c292a9d-ed52-4db3-8cf5-021f9f26bdb5 Jul 24 09:44:29 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:30 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-46a504a4-7cc2-4984-b83e-8db2b780671b tempest-GroupsTest-1598942728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2c292a9d-ed52-4db3-8cf5-021f9f26bdb5" returned: 0 in 0.748s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-46a504a4-7cc2-4984-b83e-8db2b780671b tempest-GroupsTest-1598942728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2c292a9d-ed52-4db3-8cf5-021f9f26bdb5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:30 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2c292a9d-ed52-4db3-8cf5-021f9f26bdb5 Jul 24 09:44:30 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:30 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-46a504a4-7cc2-4984-b83e-8db2b780671b tempest-GroupsTest-1598942728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2c292a9d-ed52-4db3-8cf5-021f9f26bdb5" returned: 0 in 0.488s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-46a504a4-7cc2-4984-b83e-8db2b780671b tempest-GroupsTest-1598942728 None] Lock "cinder-quobyte-2c292a9d-ed52-4db3-8cf5-021f9f26bdb5" released by "delete_volume" :: held 1.401s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:44:31 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-46a504a4-7cc2-4984-b83e-8db2b780671b tempest-GroupsTest-1598942728 None] Created reservations ['0d2b81bf-d94d-4e8f-aa1e-89ee8d0122ab'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:44:31 devstack cinder-volume[88488]: WARNING cinder.quota [None req-46a504a4-7cc2-4984-b83e-8db2b780671b tempest-GroupsTest-1598942728 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1440115502 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1440115502, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:44:31 devstack cinder-volume[88488]: WARNING cinder.quota [None req-46a504a4-7cc2-4984-b83e-8db2b780671b tempest-GroupsTest-1598942728 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1440115502 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1440115502, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:44:31 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-46a504a4-7cc2-4984-b83e-8db2b780671b tempest-GroupsTest-1598942728 None] Created reservations ['f9509742-a4b0-43c5-97bf-060d95226ef8', '88fc09d0-743a-46bc-97e8-ef12afbe7528', '6c34dcc3-3816-45ad-b963-0c7db5debc33', '23e4a01c-2683-4991-a4b2-abfb4e0e0678'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:44:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-46a504a4-7cc2-4984-b83e-8db2b780671b tempest-GroupsTest-1598942728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:44:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-46a504a4-7cc2-4984-b83e-8db2b780671b tempest-GroupsTest-1598942728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:44:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-46a504a4-7cc2-4984-b83e-8db2b780671b tempest-GroupsTest-1598942728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:44:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-46a504a4-7cc2-4984-b83e-8db2b780671b tempest-GroupsTest-1598942728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:44:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-46a504a4-7cc2-4984-b83e-8db2b780671b tempest-GroupsTest-1598942728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:44:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-46a504a4-7cc2-4984-b83e-8db2b780671b tempest-GroupsTest-1598942728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:31 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:44:31 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:32 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-46a504a4-7cc2-4984-b83e-8db2b780671b tempest-GroupsTest-1598942728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.769s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:32 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-46a504a4-7cc2-4984-b83e-8db2b780671b tempest-GroupsTest-1598942728 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:44:32 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-46a504a4-7cc2-4984-b83e-8db2b780671b tempest-GroupsTest-1598942728 None] Delete group completed successfully. Jul 24 09:44:33 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-1d35a60d-23b5-4c40-b5a6-2b15bcfd9786 tempest-GroupsTest-1598942728 None] Created reservations ['9cc1bb9c-b2b4-4fb9-84a5-7cea443eb5c5'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:44:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1d35a60d-23b5-4c40-b5a6-2b15bcfd9786 tempest-GroupsTest-1598942728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:44:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1d35a60d-23b5-4c40-b5a6-2b15bcfd9786 tempest-GroupsTest-1598942728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:44:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1d35a60d-23b5-4c40-b5a6-2b15bcfd9786 tempest-GroupsTest-1598942728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:44:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1d35a60d-23b5-4c40-b5a6-2b15bcfd9786 tempest-GroupsTest-1598942728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:44:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1d35a60d-23b5-4c40-b5a6-2b15bcfd9786 tempest-GroupsTest-1598942728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:44:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1d35a60d-23b5-4c40-b5a6-2b15bcfd9786 tempest-GroupsTest-1598942728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:33 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:44:33 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:34 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1d35a60d-23b5-4c40-b5a6-2b15bcfd9786 tempest-GroupsTest-1598942728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.789s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:34 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-1d35a60d-23b5-4c40-b5a6-2b15bcfd9786 tempest-GroupsTest-1598942728 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:44:34 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-1d35a60d-23b5-4c40-b5a6-2b15bcfd9786 tempest-GroupsTest-1598942728 None] Delete group completed successfully. Jul 24 09:44:34 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9ba9ddb0-64ae-4b3d-b12e-bd416b289330 tempest-VolumesActionsTest-284469595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f /opt/stack/data/cinder/conversion/88b509e4-a0ba-4a90-9536-15f774ffca9f.temp_image.241de3f8-f6ff-427d-ae5c-eee0370994d59hyx4dv0.img" returned: 0 in 6.714s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:34 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c3994f-94a3-41ab-b894-e11cc7806814]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:44:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9ba9ddb0-64ae-4b3d-b12e-bd416b289330 tempest-VolumesActionsTest-284469595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:34 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f Jul 24 09:44:34 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:35 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-ad205779-7b5f-47ba-8287-6710c4a06fc8 req-6c424fd3-5dc6-45bc-9812-dcc9906153c8 tempest-TestInstancesWithCinderVolumes-793657892 None] Terminate volume connection completed successfully. Jul 24 09:44:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-ad205779-7b5f-47ba-8287-6710c4a06fc8 req-6c424fd3-5dc6-45bc-9812-dcc9906153c8 tempest-TestInstancesWithCinderVolumes-793657892 None] Deleting attachment af61fe56-fbef-4828-a57d-db4dfac539b1. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:44:35 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d7e4a79b-2d9f-4ff4-96a8-23277534390c tempest-GroupsTest-1598942728 None] Group tempest-GroupsTest-Group-2047944028: creating Jul 24 09:44:35 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d7e4a79b-2d9f-4ff4-96a8-23277534390c tempest-GroupsTest-1598942728 None] Group tempest-GroupsTest-Group-2047944028: created successfully Jul 24 09:44:35 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9ba9ddb0-64ae-4b3d-b12e-bd416b289330 tempest-VolumesActionsTest-284469595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f" returned: 0 in 0.676s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:35 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-9ba9ddb0-64ae-4b3d-b12e-bd416b289330 tempest-VolumesActionsTest-284469595 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/conversion/88b509e4-a0ba-4a90-9536-15f774ffca9f.temp_image.241de3f8-f6ff-427d-ae5c-eee0370994d59hyx4dv0.img {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:44:35 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-9ba9ddb0-64ae-4b3d-b12e-bd416b289330 tempest-VolumesActionsTest-284469595 None] Converted 1024.00 MB image at 152.49 MB/s Jul 24 09:44:35 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d7e4a79b-2d9f-4ff4-96a8-23277534390c tempest-GroupsTest-1598942728 None] Create group completed successfully. Jul 24 09:44:35 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-9ba9ddb0-64ae-4b3d-b12e-bd416b289330 tempest-VolumesActionsTest-284469595 None] 241de3f8-f6ff-427d-ae5c-eee0370994d5 was raw, no need to convert to raw {{(pid=88488) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 24 09:44:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] Acquiring lock "cinder-9cce4734-7f85-4495-b6f4-15a92310d91c-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:44:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "cinder-9cce4734-7f85-4495-b6f4-15a92310d91c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:44:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] Acquiring lock "cinder-quobyte-9cce4734-7f85-4495-b6f4-15a92310d91c" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:44:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "cinder-quobyte-9cce4734-7f85-4495-b6f4-15a92310d91c" acquired by "delete_volume" :: waited 0.033s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:44:36 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67ac6ef-8a33-47c3-972b-7898819e2036]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:44:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9cce4734-7f85-4495-b6f4-15a92310d91c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:36 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9cce4734-7f85-4495-b6f4-15a92310d91c Jul 24 09:44:36 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:36 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9cce4734-7f85-4495-b6f4-15a92310d91c" returned: 0 in 0.430s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9cce4734-7f85-4495-b6f4-15a92310d91c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:36 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9cce4734-7f85-4495-b6f4-15a92310d91c Jul 24 09:44:36 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:36 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9cce4734-7f85-4495-b6f4-15a92310d91c" returned: 0 in 0.283s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "cinder-quobyte-9cce4734-7f85-4495-b6f4-15a92310d91c" released by "delete_volume" :: held 0.777s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:44:37 devstack cinder-volume[88488]: WARNING cinder.quota [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1051389755-1728598638 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1051389755-1728598638, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:44:37 devstack cinder-volume[88488]: WARNING cinder.quota [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1051389755-1728598638 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1051389755-1728598638, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] Created reservations ['7ecb818c-9861-4ac2-84e3-6931d1c70093', '1fdc27c1-12a8-459d-9f9e-d65a274d69fb', 'f180cdf4-70d4-48d4-a972-259ae6592c6d', 'ca979c41-e85a-4cad-af9d-e6c9450ee458'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Flow 'volume_create_manager' (2dfc08c0-d408-448a-b188-f2a245dced41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (197dabdb-37f9-431b-8748-d195ee8ac3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (197dabdb-37f9-431b-8748-d195ee8ac3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-430494302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e78c67b2-99b9-44d9-ab1f-5ac2dfd759a9,host='devstack@QuobyteHD#QuobyteHD',id=db19d32a-ab4b-46cc-b74e-879ad2f2b48f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f1eacdeffac424bb8077b2d499be5c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:44:37Z,use_quota=True,user_id='a380d844f0a04191b4793489f3a2fbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f2901ab-0e04-4a24-ae88-a1bda2788f0b),volume_type_id=4f2901ab-0e04-4a24-ae88-a1bda2788f0b)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32b2921-831a-4b42-b999-32fec6deb2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32b2921-831a-4b42-b999-32fec6deb2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce52f834-fb0c-4d7c-b56f-7314c54518c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce52f834-fb0c-4d7c-b56f-7314c54518c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db19d32a-ab4b-46cc-b74e-879ad2f2b48f', 'volume_name': 'volume-db19d32a-ab4b-46cc-b74e-879ad2f2b48f', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9beeb489-fa95-4f9c-9901-94c5a6bd26fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9beeb489-fa95-4f9c-9901-94c5a6bd26fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a06b7c-5c86-4627-9929-4719ff3bc3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:44:37 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Volume db19d32a-ab4b-46cc-b74e-879ad2f2b48f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db19d32a-ab4b-46cc-b74e-879ad2f2b48f', 'volume_size': 1} Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:44:37 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:44:37 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:44:37 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.373s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:44:37 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] Deleted volume successfully. Jul 24 09:44:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d524467c-7c98-42b8-a8fa-17a825527d06 tempest-TestInstancesWithCinderVolumes-793657892 None] Lock "cinder-9cce4734-7f85-4495-b6f4-15a92310d91c-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:44:47 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=121,cinder:UPDATE=119,cinder:INSERT=24,cinder:DELETE=8 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:44:47 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=104,cinder:INSERT=32,cinder:UPDATE=128,cinder:DELETE=8 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:45:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9ba9ddb0-64ae-4b3d-b12e-bd416b289330 tempest-VolumesActionsTest-284469595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.910s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9ba9ddb0-64ae-4b3d-b12e-bd416b289330 tempest-VolumesActionsTest-284469595 None] Uploaded volume to glance image-id: 241de3f8-f6ff-427d-ae5c-eee0370994d5. {{(pid=88488) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 24 09:45:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.444s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e78c67b2-99b9-44d9-ab1f-5ac2dfd759a9,created_at=2026-07-24T07:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-430494302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e78c67b2-99b9-44d9-ab1f-5ac2dfd759a9,host='devstack@QuobyteHD#QuobyteHD',id=db19d32a-ab4b-46cc-b74e-879ad2f2b48f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f1eacdeffac424bb8077b2d499be5c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:44:37Z,use_quota=True,user_id='a380d844f0a04191b4793489f3a2fbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f2901ab-0e04-4a24-ae88-a1bda2788f0b),volume_type_id=4f2901ab-0e04-4a24-ae88-a1bda2788f0b)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:45:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Creating volume db19d32a-ab4b-46cc-b74e-879ad2f2b48f {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:45:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:45:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:45:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:45:00 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:45:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-db19d32a-ab4b-46cc-b74e-879ad2f2b48f 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:00 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-9ba9ddb0-64ae-4b3d-b12e-bd416b289330 tempest-VolumesActionsTest-284469595 None] Copy volume to image completed successfully. Jul 24 09:45:00 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-db19d32a-ab4b-46cc-b74e-879ad2f2b48f 1073741824 Jul 24 09:45:00 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:01 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-db19d32a-ab4b-46cc-b74e-879ad2f2b48f 1073741824" returned: 0 in 0.573s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-db19d32a-ab4b-46cc-b74e-879ad2f2b48f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:01 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-db19d32a-ab4b-46cc-b74e-879ad2f2b48f Jul 24 09:45:01 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:01 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-db19d32a-ab4b-46cc-b74e-879ad2f2b48f" returned: 0 in 0.292s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:45:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a06b7c-5c86-4627-9929-4719ff3bc3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db19d32a-ab4b-46cc-b74e-879ad2f2b48f', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4567af60-80fc-45af-b1ec-6dd40ff9d08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:01 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Volume volume-db19d32a-ab4b-46cc-b74e-879ad2f2b48f (db19d32a-ab4b-46cc-b74e-879ad2f2b48f): created successfully Jul 24 09:45:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4567af60-80fc-45af-b1ec-6dd40ff9d08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Flow 'volume_create_manager' (2dfc08c0-d408-448a-b188-f2a245dced41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:45:01 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-fd4953f5-4dc6-42c8-92ad-b8adde9f7536 tempest-GroupsTest-1598942728 None] Created volume successfully. Jul 24 09:45:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:02 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[80387105-6bfd-4d00-a102-14fbcf24ea1a]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:02 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f Jul 24 09:45:02 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:03 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f" returned: 0 in 0.483s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:03 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[be27dccf-c707-4d49-9a83-6cfb3d31f760]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:03 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f Jul 24 09:45:03 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:03 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f" returned: 0 in 0.490s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f /opt/stack/data/cinder/conversion/88b509e4-a0ba-4a90-9536-15f774ffca9f.temp_image.f18a6cd8-572c-4c8f-b19a-27681289977b70x2ag9u.img {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:03 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f /opt/stack/data/cinder/conversion/88b509e4-a0ba-4a90-9536-15f774ffca9f.temp_image.f18a6cd8-572c-4c8f-b19a-27681289977b70x2ag9u.img Jul 24 09:45:03 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:03 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:45:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Flow 'volume_create_manager' (d2ece779-ddf4-4908-b543-7f6af45f4a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:45:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fbc36bb-c85f-4bfd-ae96-61bc457e7d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fbc36bb-c85f-4bfd-ae96-61bc457e7d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1622706564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e78c67b2-99b9-44d9-ab1f-5ac2dfd759a9,host='devstack@QuobyteHD#QuobyteHD',id=cab773d1-d1dd-4763-8874-987032474afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f1eacdeffac424bb8077b2d499be5c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:45:04Z,use_quota=True,user_id='a380d844f0a04191b4793489f3a2fbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f2901ab-0e04-4a24-ae88-a1bda2788f0b),volume_type_id=4f2901ab-0e04-4a24-ae88-a1bda2788f0b)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0f369d-a3e0-491c-913c-bce8e0ff9893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0f369d-a3e0-491c-913c-bce8e0ff9893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24bad93-8ca0-4cc9-8268-87c1bff736f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24bad93-8ca0-4cc9-8268-87c1bff736f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cab773d1-d1dd-4763-8874-987032474afa', 'volume_name': 'volume-cab773d1-d1dd-4763-8874-987032474afa', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262ab6f3-8090-4260-83fe-6879b4144c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262ab6f3-8090-4260-83fe-6879b4144c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fab264e-816d-4eff-b8ba-2e1d461a2eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:03 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Volume cab773d1-d1dd-4763-8874-987032474afa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cab773d1-d1dd-4763-8874-987032474afa', 'volume_size': 1} Jul 24 09:45:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:09 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f /opt/stack/data/cinder/conversion/88b509e4-a0ba-4a90-9536-15f774ffca9f.temp_image.f18a6cd8-572c-4c8f-b19a-27681289977b70x2ag9u.img" returned: 0 in 6.243s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:10 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc9fb2a-c926-46e8-9f2c-e23ce33ab368]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:10 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f Jul 24 09:45:10 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:10 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f" returned: 0 in 0.625s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:10 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/conversion/88b509e4-a0ba-4a90-9536-15f774ffca9f.temp_image.f18a6cd8-572c-4c8f-b19a-27681289977b70x2ag9u.img {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:45:10 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] Converted 1024.00 MB image at 163.98 MB/s Jul 24 09:45:10 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] f18a6cd8-572c-4c8f-b19a-27681289977b was raw, converting to qcow2 {{(pid=88488) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 24 09:45:10 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[406dbd0f-f81e-4c71-8e2f-ceecdf9b1cce]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/88b509e4-a0ba-4a90-9536-15f774ffca9f.temp_image.f18a6cd8-572c-4c8f-b19a-27681289977b70x2ag9u.img {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:10 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/88b509e4-a0ba-4a90-9536-15f774ffca9f.temp_image.f18a6cd8-572c-4c8f-b19a-27681289977b70x2ag9u.img Jul 24 09:45:10 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:11 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/88b509e4-a0ba-4a90-9536-15f774ffca9f.temp_image.f18a6cd8-572c-4c8f-b19a-27681289977b70x2ag9u.img" returned: 0 in 0.466s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/88b509e4-a0ba-4a90-9536-15f774ffca9f.temp_image.f18a6cd8-572c-4c8f-b19a-27681289977b70x2ag9u.img {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:11 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/88b509e4-a0ba-4a90-9536-15f774ffca9f.temp_image.f18a6cd8-572c-4c8f-b19a-27681289977b70x2ag9u.img Jul 24 09:45:11 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:11 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/88b509e4-a0ba-4a90-9536-15f774ffca9f.temp_image.f18a6cd8-572c-4c8f-b19a-27681289977b70x2ag9u.img" returned: 1 in 0.378s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/88b509e4-a0ba-4a90-9536-15f774ffca9f.temp_image.f18a6cd8-572c-4c8f-b19a-27681289977b70x2ag9u.img' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:45:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/88b509e4-a0ba-4a90-9536-15f774ffca9f.temp_image.f18a6cd8-572c-4c8f-b19a-27681289977b70x2ag9u.img /opt/stack/data/cinder/conversion/vol_upload_lupn5tb2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:11 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/88b509e4-a0ba-4a90-9536-15f774ffca9f.temp_image.f18a6cd8-572c-4c8f-b19a-27681289977b70x2ag9u.img /opt/stack/data/cinder/conversion/vol_upload_lupn5tb2 Jul 24 09:45:11 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:11 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/88b509e4-a0ba-4a90-9536-15f774ffca9f.temp_image.f18a6cd8-572c-4c8f-b19a-27681289977b70x2ag9u.img /opt/stack/data/cinder/conversion/vol_upload_lupn5tb2" returned: 0 in 0.308s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:11 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] Image conversion details: src /opt/stack/data/cinder/conversion/88b509e4-a0ba-4a90-9536-15f774ffca9f.temp_image.f18a6cd8-572c-4c8f-b19a-27681289977b70x2ag9u.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_lupn5tb2 {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:45:11 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 24 09:45:11 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd765871-e052-4114-8bb1-3459d98eb5de]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lupn5tb2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:11 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lupn5tb2 Jul 24 09:45:11 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:12 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lupn5tb2" returned: 0 in 0.419s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.126s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] Uploaded volume to glance image-id: f18a6cd8-572c-4c8f-b19a-27681289977b. {{(pid=88488) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 24 09:45:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.869s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e78c67b2-99b9-44d9-ab1f-5ac2dfd759a9,created_at=2026-07-24T07:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1622706564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e78c67b2-99b9-44d9-ab1f-5ac2dfd759a9,host='devstack@QuobyteHD#QuobyteHD',id=cab773d1-d1dd-4763-8874-987032474afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f1eacdeffac424bb8077b2d499be5c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:45:04Z,use_quota=True,user_id='a380d844f0a04191b4793489f3a2fbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f2901ab-0e04-4a24-ae88-a1bda2788f0b),volume_type_id=4f2901ab-0e04-4a24-ae88-a1bda2788f0b)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:45:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Creating volume cab773d1-d1dd-4763-8874-987032474afa {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:45:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:45:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:45:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:45:13 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:45:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cab773d1-d1dd-4763-8874-987032474afa 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:13 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-1f348909-4533-4274-b155-7d3255755fe1 tempest-VolumesActionsTest-284469595 None] Copy volume to image completed successfully. Jul 24 09:45:13 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cab773d1-d1dd-4763-8874-987032474afa 1073741824 Jul 24 09:45:13 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:14 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cab773d1-d1dd-4763-8874-987032474afa 1073741824" returned: 0 in 0.511s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cab773d1-d1dd-4763-8874-987032474afa {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:14 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cab773d1-d1dd-4763-8874-987032474afa Jul 24 09:45:14 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:14 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cab773d1-d1dd-4763-8874-987032474afa" returned: 0 in 0.342s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:45:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fab264e-816d-4eff-b8ba-2e1d461a2eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cab773d1-d1dd-4763-8874-987032474afa', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba892dc3-567a-4ea2-a0d8-df23df5a76ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:14 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Volume volume-cab773d1-d1dd-4763-8874-987032474afa (cab773d1-d1dd-4763-8874-987032474afa): created successfully Jul 24 09:45:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba892dc3-567a-4ea2-a0d8-df23df5a76ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Flow 'volume_create_manager' (d2ece779-ddf4-4908-b543-7f6af45f4a82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:45:14 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-fe4efb9c-94aa-4b45-8985-7b5a6dc50cf3 tempest-GroupsTest-1598942728 None] Created volume successfully. Jul 24 09:45:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:45:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:45:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:45:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:15 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:45:15 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:15 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.329s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:45:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:45:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 28 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:45:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:45:15 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d8b60f42-fa1d-4ee6-b41e-b1bb1c433594 tempest-VolumesActionsTest-284469595 None] Acquiring lock "cinder-88b509e4-a0ba-4a90-9536-15f774ffca9f-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:15 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d8b60f42-fa1d-4ee6-b41e-b1bb1c433594 tempest-VolumesActionsTest-284469595 None] Lock "cinder-88b509e4-a0ba-4a90-9536-15f774ffca9f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:15 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d8b60f42-fa1d-4ee6-b41e-b1bb1c433594 tempest-VolumesActionsTest-284469595 None] Acquiring lock "cinder-quobyte-88b509e4-a0ba-4a90-9536-15f774ffca9f" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:15 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d8b60f42-fa1d-4ee6-b41e-b1bb1c433594 tempest-VolumesActionsTest-284469595 None] Lock "cinder-quobyte-88b509e4-a0ba-4a90-9536-15f774ffca9f" acquired by "delete_volume" :: waited 0.027s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:15 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b108c264-3e91-46b5-800d-3115984e7a98]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d8b60f42-fa1d-4ee6-b41e-b1bb1c433594 tempest-VolumesActionsTest-284469595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:15 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f Jul 24 09:45:15 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:16 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d29df33a-833b-4587-9950-8dd81262e087 tempest-GroupsTest-1598942728 None] Update group completed successfully. Jul 24 09:45:16 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d8b60f42-fa1d-4ee6-b41e-b1bb1c433594 tempest-VolumesActionsTest-284469595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f" returned: 0 in 0.571s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d8b60f42-fa1d-4ee6-b41e-b1bb1c433594 tempest-VolumesActionsTest-284469595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:16 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f Jul 24 09:45:16 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:16 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d8b60f42-fa1d-4ee6-b41e-b1bb1c433594 tempest-VolumesActionsTest-284469595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88b509e4-a0ba-4a90-9536-15f774ffca9f" returned: 0 in 0.312s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:16 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d8b60f42-fa1d-4ee6-b41e-b1bb1c433594 tempest-VolumesActionsTest-284469595 None] Lock "cinder-quobyte-88b509e4-a0ba-4a90-9536-15f774ffca9f" released by "delete_volume" :: held 0.947s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:16 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-d8b60f42-fa1d-4ee6-b41e-b1bb1c433594 tempest-VolumesActionsTest-284469595 None] Created reservations ['f2d69349-9a85-4089-a0b1-75ff07346a38', '2f38c7f9-70e4-46d7-a5c9-9e3a04aa8623', 'c4229549-1bcd-43f9-a666-9a7b0586c978', '1c757fb3-0829-4e97-9a2c-fd48b22a9ec8'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:45:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d8b60f42-fa1d-4ee6-b41e-b1bb1c433594 tempest-VolumesActionsTest-284469595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d8b60f42-fa1d-4ee6-b41e-b1bb1c433594 tempest-VolumesActionsTest-284469595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d8b60f42-fa1d-4ee6-b41e-b1bb1c433594 tempest-VolumesActionsTest-284469595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:45:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d8b60f42-fa1d-4ee6-b41e-b1bb1c433594 tempest-VolumesActionsTest-284469595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:45:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d8b60f42-fa1d-4ee6-b41e-b1bb1c433594 tempest-VolumesActionsTest-284469595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d8b60f42-fa1d-4ee6-b41e-b1bb1c433594 tempest-VolumesActionsTest-284469595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:16 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:45:16 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:17 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d8b60f42-fa1d-4ee6-b41e-b1bb1c433594 tempest-VolumesActionsTest-284469595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.370s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:17 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-d8b60f42-fa1d-4ee6-b41e-b1bb1c433594 tempest-VolumesActionsTest-284469595 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:45:17 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d8b60f42-fa1d-4ee6-b41e-b1bb1c433594 tempest-VolumesActionsTest-284469595 None] Deleted volume successfully. Jul 24 09:45:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d8b60f42-fa1d-4ee6-b41e-b1bb1c433594 tempest-VolumesActionsTest-284469595 None] Lock "cinder-88b509e4-a0ba-4a90-9536-15f774ffca9f-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:17 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-cf292091-0963-48cb-8a91-2a41a0497e72 tempest-GroupsTest-1598942728 None] Update group completed successfully. Jul 24 09:45:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Acquiring lock "cinder-quobyte-cab773d1-d1dd-4763-8874-987032474afa" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Lock "cinder-quobyte-cab773d1-d1dd-4763-8874-987032474afa" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:19 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad52430-8034-406d-b426-ae115dd63cf7]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cab773d1-d1dd-4763-8874-987032474afa {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:19 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cab773d1-d1dd-4763-8874-987032474afa Jul 24 09:45:19 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:19 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cab773d1-d1dd-4763-8874-987032474afa" returned: 0 in 0.453s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cab773d1-d1dd-4763-8874-987032474afa {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:19 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cab773d1-d1dd-4763-8874-987032474afa Jul 24 09:45:19 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:20 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cab773d1-d1dd-4763-8874-987032474afa" returned: 0 in 0.330s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Lock "cinder-quobyte-cab773d1-d1dd-4763-8874-987032474afa" released by "delete_volume" :: held 0.849s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Acquiring lock "cinder-quobyte-db19d32a-ab4b-46cc-b74e-879ad2f2b48f" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Lock "cinder-quobyte-db19d32a-ab4b-46cc-b74e-879ad2f2b48f" acquired by "delete_volume" :: waited 0.020s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:20 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4440c1b2-ab67-4c80-9248-f4cd38b1cb8d]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-db19d32a-ab4b-46cc-b74e-879ad2f2b48f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:20 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-db19d32a-ab4b-46cc-b74e-879ad2f2b48f Jul 24 09:45:20 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:20 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-db19d32a-ab4b-46cc-b74e-879ad2f2b48f" returned: 0 in 0.523s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-db19d32a-ab4b-46cc-b74e-879ad2f2b48f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:20 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-db19d32a-ab4b-46cc-b74e-879ad2f2b48f Jul 24 09:45:20 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:21 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-db19d32a-ab4b-46cc-b74e-879ad2f2b48f" returned: 0 in 0.301s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:21 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Lock "cinder-quobyte-db19d32a-ab4b-46cc-b74e-879ad2f2b48f" released by "delete_volume" :: held 0.903s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:21 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Created reservations ['d36d180e-0b2a-4f6e-8287-3368a99a011f'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:45:21 devstack cinder-volume[88488]: WARNING cinder.quota [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-648689148 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-648689148, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:45:21 devstack cinder-volume[88488]: WARNING cinder.quota [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-648689148 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-648689148, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:45:21 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Created reservations ['c9e0ed2d-6971-45bc-b37f-663599478377', 'ce8919fe-954d-4946-8bbb-c7eab2c050c2', '7678ad5b-1472-426b-9d19-f67dc753148f', '771c095b-cc74-4da5-bc4b-7c61380a362c'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:45:21 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Created reservations ['d11b54fd-8807-4c0a-9f20-88deff387a17', '3c5d74b5-19e5-475d-abcd-0b099bd9ab30', '0983b7eb-ed4e-4ceb-b466-effd579a0939', '82c588d3-3fb0-4c66-bdd0-36526e2a9a0b'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:45:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:21 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:45:21 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:45:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:21 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:45:21 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:22 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.416s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:22 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:45:22 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-9f83f206-3bac-463d-8b30-9b238ab650c5 tempest-GroupsTest-1598942728 None] Delete group completed successfully. Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Flow 'volume_create_manager' (c126c387-7841-46b4-8be5-02997c584eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e135814-4ad0-47d6-a3f6-a6f6a7958473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e135814-4ad0-47d6-a3f6-a6f6a7958473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1601400944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=565d18c5-a561-429e-b23e-31c40945dce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf46d543401e40cca9d8ca6269d988f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:45:31Z,use_quota=True,user_id='473986600b62479597c5d7546ae2014a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63948cb5-0505-4dcb-9945-ba3ef48b2a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63948cb5-0505-4dcb-9945-ba3ef48b2a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a4c262-9eba-4b6f-9f88-3be6fb3d0b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a4c262-9eba-4b6f-9f88-3be6fb3d0b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '565d18c5-a561-429e-b23e-31c40945dce1', 'volume_name': 'volume-565d18c5-a561-429e-b23e-31c40945dce1', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2119cf-e260-4d68-b0d5-14687f3d7d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2119cf-e260-4d68-b0d5-14687f3d7d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55383918-9326-4979-aa2a-5c4af9b6c47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:30 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Volume 565d18c5-a561-429e-b23e-31c40945dce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-565d18c5-a561-429e-b23e-31c40945dce1', 'volume_size': 1} Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1601400944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=565d18c5-a561-429e-b23e-31c40945dce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf46d543401e40cca9d8ca6269d988f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:45:31Z,use_quota=True,user_id='473986600b62479597c5d7546ae2014a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Creating volume 565d18c5-a561-429e-b23e-31c40945dce1 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:45:30 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:45:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:31 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1 1073741824 Jul 24 09:45:31 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:31 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1 1073741824" returned: 0 in 0.876s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:31 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1 Jul 24 09:45:31 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:32 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1" returned: 0 in 0.545s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55383918-9326-4979-aa2a-5c4af9b6c47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-565d18c5-a561-429e-b23e-31c40945dce1', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc189111-be94-460c-8a71-1ec91cda1bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Flow 'volume_create_manager' (6b1d7361-93f6-4362-8120-1fd4c8a6cd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536892e1-5d89-4de4-828e-c8cc631f1c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:32 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Volume volume-565d18c5-a561-429e-b23e-31c40945dce1 (565d18c5-a561-429e-b23e-31c40945dce1): created successfully Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc189111-be94-460c-8a71-1ec91cda1bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Flow 'volume_create_manager' (c126c387-7841-46b4-8be5-02997c584eac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536892e1-5d89-4de4-828e-c8cc631f1c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1672155636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78b26171-37fe-488d-b9b2-ed7bb0e18f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2941b1c14e1746f698ff5b3d2c2ae676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:45:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:45:32Z,use_quota=True,user_id='cb1340ca8ff0473bbc51ca7a4776b991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5884a19-7a95-4a92-8f07-3f008262fbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5884a19-7a95-4a92-8f07-3f008262fbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ccfd826-4f8c-490c-8c2a-533ab0a16887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ccfd826-4f8c-490c-8c2a-533ab0a16887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78b26171-37fe-488d-b9b2-ed7bb0e18f1f', 'volume_name': 'volume-78b26171-37fe-488d-b9b2-ed7bb0e18f1f', 'volume_size': 2}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5354066e-9a7c-4ba0-9135-b102ee5b4bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5354066e-9a7c-4ba0-9135-b102ee5b4bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f94adaa-1c84-4f96-8c68-56b4b3a742c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:32 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Volume 78b26171-37fe-488d-b9b2-ed7bb0e18f1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78b26171-37fe-488d-b9b2-ed7bb0e18f1f', 'volume_size': 2} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1672155636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78b26171-37fe-488d-b9b2-ed7bb0e18f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2941b1c14e1746f698ff5b3d2c2ae676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:45:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:45:32Z,use_quota=True,user_id='cb1340ca8ff0473bbc51ca7a4776b991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Creating volume 78b26171-37fe-488d-b9b2-ed7bb0e18f1f {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:45:32 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:45:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-78b26171-37fe-488d-b9b2-ed7bb0e18f1f 2147483648 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:32 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-ca96407f-40f9-42bb-8545-63e11eae8f0c tempest-SnapshotsActionsTest-1429507181 None] Created volume successfully. Jul 24 09:45:32 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-78b26171-37fe-488d-b9b2-ed7bb0e18f1f 2147483648 Jul 24 09:45:32 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c2afcdef-f179-4e47-8c25-5ea3ca28ae32 tempest-SnapshotsActionsTest-1429507181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:33 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-78b26171-37fe-488d-b9b2-ed7bb0e18f1f 2147483648" returned: 0 in 1.139s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-78b26171-37fe-488d-b9b2-ed7bb0e18f1f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:33 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-78b26171-37fe-488d-b9b2-ed7bb0e18f1f Jul 24 09:45:33 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:34 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-78b26171-37fe-488d-b9b2-ed7bb0e18f1f" returned: 0 in 0.534s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:34 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:45:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c2afcdef-f179-4e47-8c25-5ea3ca28ae32 tempest-SnapshotsActionsTest-1429507181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.306s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:34 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-c2afcdef-f179-4e47-8c25-5ea3ca28ae32 tempest-SnapshotsActionsTest-1429507181 None] Creating offline snapshot 9972c10d-b3d5-49ac-89bb-ad29012f3c57 of volume 565d18c5-a561-429e-b23e-31c40945dce1 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:45:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f94adaa-1c84-4f96-8c68-56b4b3a742c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78b26171-37fe-488d-b9b2-ed7bb0e18f1f', 'volume_size': 2}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84cecea6-06bb-459b-9b29-955083747dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:34 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87eb8ab-4405-41fe-92af-4dcbaebf6feb]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c2afcdef-f179-4e47-8c25-5ea3ca28ae32 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:34 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Volume volume-78b26171-37fe-488d-b9b2-ed7bb0e18f1f (78b26171-37fe-488d-b9b2-ed7bb0e18f1f): created successfully Jul 24 09:45:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84cecea6-06bb-459b-9b29-955083747dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Flow 'volume_create_manager' (6b1d7361-93f6-4362-8120-1fd4c8a6cd6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:45:34 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-3859a5a3-f5c3-4b95-aab4-edfa3b59a135 tempest-VolumesCloneNegativeTest-1128969360 None] Created volume successfully. Jul 24 09:45:34 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1 Jul 24 09:45:34 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:35 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c2afcdef-f179-4e47-8c25-5ea3ca28ae32 tempest-SnapshotsActionsTest-1429507181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1" returned: 0 in 0.514s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c2afcdef-f179-4e47-8c25-5ea3ca28ae32 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:35 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 1G Jul 24 09:45:35 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:35 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c2afcdef-f179-4e47-8c25-5ea3ca28ae32 tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 1G" returned: 0 in 0.836s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c2afcdef-f179-4e47-8c25-5ea3ca28ae32 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565d18c5-a561-429e-b23e-31c40945dce1 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:35 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565d18c5-a561-429e-b23e-31c40945dce1 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 Jul 24 09:45:35 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7156994c-0c80-4509-81ee-0a11093289ee tempest-VolumesCloneNegativeTest-1128969360 None] Acquiring lock "cinder-78b26171-37fe-488d-b9b2-ed7bb0e18f1f-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7156994c-0c80-4509-81ee-0a11093289ee tempest-VolumesCloneNegativeTest-1128969360 None] Lock "cinder-78b26171-37fe-488d-b9b2-ed7bb0e18f1f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7156994c-0c80-4509-81ee-0a11093289ee tempest-VolumesCloneNegativeTest-1128969360 None] Acquiring lock "cinder-quobyte-78b26171-37fe-488d-b9b2-ed7bb0e18f1f" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7156994c-0c80-4509-81ee-0a11093289ee tempest-VolumesCloneNegativeTest-1128969360 None] Lock "cinder-quobyte-78b26171-37fe-488d-b9b2-ed7bb0e18f1f" acquired by "delete_volume" :: waited 0.027s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:36 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1521a03-88f9-4083-ac19-41ad3ddd9190]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7156994c-0c80-4509-81ee-0a11093289ee tempest-VolumesCloneNegativeTest-1128969360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-78b26171-37fe-488d-b9b2-ed7bb0e18f1f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:36 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-78b26171-37fe-488d-b9b2-ed7bb0e18f1f Jul 24 09:45:36 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:36 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c2afcdef-f179-4e47-8c25-5ea3ca28ae32 tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565d18c5-a561-429e-b23e-31c40945dce1 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57" returned: 0 in 0.929s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:36 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-c2afcdef-f179-4e47-8c25-5ea3ca28ae32 tempest-SnapshotsActionsTest-1429507181 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 is being set with open permissions: ugo+rw Jul 24 09:45:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c2afcdef-f179-4e47-8c25-5ea3ca28ae32 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:36 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 Jul 24 09:45:36 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:37 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7156994c-0c80-4509-81ee-0a11093289ee tempest-VolumesCloneNegativeTest-1128969360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-78b26171-37fe-488d-b9b2-ed7bb0e18f1f" returned: 0 in 0.713s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7156994c-0c80-4509-81ee-0a11093289ee tempest-VolumesCloneNegativeTest-1128969360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-78b26171-37fe-488d-b9b2-ed7bb0e18f1f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:37 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-78b26171-37fe-488d-b9b2-ed7bb0e18f1f Jul 24 09:45:37 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:37 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7156994c-0c80-4509-81ee-0a11093289ee tempest-VolumesCloneNegativeTest-1128969360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-78b26171-37fe-488d-b9b2-ed7bb0e18f1f" returned: 0 in 0.434s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:37 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7156994c-0c80-4509-81ee-0a11093289ee tempest-VolumesCloneNegativeTest-1128969360 None] Lock "cinder-quobyte-78b26171-37fe-488d-b9b2-ed7bb0e18f1f" released by "delete_volume" :: held 1.261s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c2afcdef-f179-4e47-8c25-5ea3ca28ae32 tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57" returned: 0 in 0.644s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c2afcdef-f179-4e47-8c25-5ea3ca28ae32 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:37 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.info Jul 24 09:45:37 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:37 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-7156994c-0c80-4509-81ee-0a11093289ee tempest-VolumesCloneNegativeTest-1128969360 None] Created reservations ['45808de8-32f5-4c74-9a2d-65a06cbd8b55', 'af2209ea-7a78-48e6-96e3-92a91b0ff548', '7d1d5902-79d1-46eb-b6a5-ca9e7776cfe2', '6acd0d66-42ef-4a19-8ab5-cc9291d8b6db'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:45:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7156994c-0c80-4509-81ee-0a11093289ee tempest-VolumesCloneNegativeTest-1128969360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7156994c-0c80-4509-81ee-0a11093289ee tempest-VolumesCloneNegativeTest-1128969360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7156994c-0c80-4509-81ee-0a11093289ee tempest-VolumesCloneNegativeTest-1128969360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:45:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7156994c-0c80-4509-81ee-0a11093289ee tempest-VolumesCloneNegativeTest-1128969360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:45:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7156994c-0c80-4509-81ee-0a11093289ee tempest-VolumesCloneNegativeTest-1128969360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7156994c-0c80-4509-81ee-0a11093289ee tempest-VolumesCloneNegativeTest-1128969360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:37 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:45:37 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:38 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c2afcdef-f179-4e47-8c25-5ea3ca28ae32 tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.info" returned: 0 in 0.608s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:38 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-c2afcdef-f179-4e47-8c25-5ea3ca28ae32 tempest-SnapshotsActionsTest-1429507181 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.info is being set with open permissions: ugo+rw Jul 24 09:45:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c2afcdef-f179-4e47-8c25-5ea3ca28ae32 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:38 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7156994c-0c80-4509-81ee-0a11093289ee tempest-VolumesCloneNegativeTest-1128969360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.386s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:38 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-7156994c-0c80-4509-81ee-0a11093289ee tempest-VolumesCloneNegativeTest-1128969360 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:45:38 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.info Jul 24 09:45:38 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:38 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-7156994c-0c80-4509-81ee-0a11093289ee tempest-VolumesCloneNegativeTest-1128969360 None] Deleted volume successfully. Jul 24 09:45:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7156994c-0c80-4509-81ee-0a11093289ee tempest-VolumesCloneNegativeTest-1128969360 None] Lock "cinder-78b26171-37fe-488d-b9b2-ed7bb0e18f1f-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:38 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c2afcdef-f179-4e47-8c25-5ea3ca28ae32 tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.info" returned: 0 in 0.700s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c2afcdef-f179-4e47-8c25-5ea3ca28ae32 tempest-SnapshotsActionsTest-1429507181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.509s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:38 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c2afcdef-f179-4e47-8c25-5ea3ca28ae32 tempest-SnapshotsActionsTest-1429507181 None] Create snapshot completed successfully Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Flow 'volume_create_manager' (1ab76ea5-cff8-4903-a6dc-2898ccd4a2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ddb8f0-50f3-4cac-942c-7725a23d9008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ddb8f0-50f3-4cac-942c-7725a23d9008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-750824511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d2cde3-4aa4-4edb-8fdf-f7f133f38988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764557bb570c433381b71042b55f619a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:45:39Z,use_quota=True,user_id='bf0034602c7c45b288c615d64e9513f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc08372-17bb-4bb9-861b-e27c0b46905f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc08372-17bb-4bb9-861b-e27c0b46905f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e2457d-1aff-4568-b475-e762659fe5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e2457d-1aff-4568-b475-e762659fe5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48d2cde3-4aa4-4edb-8fdf-f7f133f38988', 'volume_name': 'volume-48d2cde3-4aa4-4edb-8fdf-f7f133f38988', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a755805-5674-4753-bf16-db1c1158a71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a755805-5674-4753-bf16-db1c1158a71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4368f6ac-f64e-4708-bd3a-65e5e988a2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:39 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Volume 48d2cde3-4aa4-4edb-8fdf-f7f133f38988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48d2cde3-4aa4-4edb-8fdf-f7f133f38988', 'volume_size': 1} Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-750824511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d2cde3-4aa4-4edb-8fdf-f7f133f38988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764557bb570c433381b71042b55f619a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:45:39Z,use_quota=True,user_id='bf0034602c7c45b288c615d64e9513f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Creating volume 48d2cde3-4aa4-4edb-8fdf-f7f133f38988 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:45:39 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:45:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-48d2cde3-4aa4-4edb-8fdf-f7f133f38988 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:39 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-48d2cde3-4aa4-4edb-8fdf-f7f133f38988 1073741824 Jul 24 09:45:39 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:40 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-48d2cde3-4aa4-4edb-8fdf-f7f133f38988 1073741824" returned: 0 in 1.181s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-48d2cde3-4aa4-4edb-8fdf-f7f133f38988 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:40 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-48d2cde3-4aa4-4edb-8fdf-f7f133f38988 Jul 24 09:45:40 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:40 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-48d2cde3-4aa4-4edb-8fdf-f7f133f38988" returned: 0 in 0.434s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:45:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4368f6ac-f64e-4708-bd3a-65e5e988a2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48d2cde3-4aa4-4edb-8fdf-f7f133f38988', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186a6e02-3497-432a-b583-7b48cf2d4bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:41 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Volume volume-48d2cde3-4aa4-4edb-8fdf-f7f133f38988 (48d2cde3-4aa4-4edb-8fdf-f7f133f38988): created successfully Jul 24 09:45:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186a6e02-3497-432a-b583-7b48cf2d4bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Flow 'volume_create_manager' (1ab76ea5-cff8-4903-a6dc-2898ccd4a2da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:45:41 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-3f902dc8-f408-424c-b8bb-303792795957 tempest-VolumesActionsTest-813460047 None] Created volume successfully. Jul 24 09:45:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3c2c2d84-30c3-41e0-b253-cc306d83df00 tempest-SnapshotsActionsTest-1429507181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3c2c2d84-30c3-41e0-b253-cc306d83df00 tempest-SnapshotsActionsTest-1429507181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-3c2c2d84-30c3-41e0-b253-cc306d83df00 tempest-SnapshotsActionsTest-1429507181 None] Creating offline snapshot ca30e5dd-ad6b-436f-aa49-f16ad972b608 of volume 565d18c5-a561-429e-b23e-31c40945dce1 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:45:41 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-84b17b28-8fc1-400d-beb2-c52b596e287b tempest-VolumesActionsTest-813460047 None] Acquiring lock "cinder-48d2cde3-4aa4-4edb-8fdf-f7f133f38988" by "attach_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:41 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ca38c5-327d-46ef-867e-f003868aae34]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3c2c2d84-30c3-41e0-b253-cc306d83df00 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:41 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-84b17b28-8fc1-400d-beb2-c52b596e287b tempest-VolumesActionsTest-813460047 None] Lock "cinder-48d2cde3-4aa4-4edb-8fdf-f7f133f38988" acquired by "attach_volume" :: waited 0.034s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:41 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-84b17b28-8fc1-400d-beb2-c52b596e287b tempest-VolumesActionsTest-813460047 None] Attaching volume 48d2cde3-4aa4-4edb-8fdf-f7f133f38988 to instance 9f57bb2b-9015-4c7a-8f6e-4dd6db11f75a at mountpoint /dev/vdb on host None. Jul 24 09:45:41 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-84b17b28-8fc1-400d-beb2-c52b596e287b tempest-VolumesActionsTest-813460047 None] Attach volume completed successfully. Jul 24 09:45:41 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-84b17b28-8fc1-400d-beb2-c52b596e287b tempest-VolumesActionsTest-813460047 None] Lock "cinder-48d2cde3-4aa4-4edb-8fdf-f7f133f38988" released by "attach_volume" :: held 0.133s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:41 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 Jul 24 09:45:41 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:42 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3c2c2d84-30c3-41e0-b253-cc306d83df00 tempest-SnapshotsActionsTest-1429507181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57" returned: 0 in 0.877s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:42 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-3c2c2d84-30c3-41e0-b253-cc306d83df00 tempest-SnapshotsActionsTest-1429507181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-565d18c5-a561-429e-b23e-31c40945dce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:45:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3c2c2d84-30c3-41e0-b253-cc306d83df00 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.ca30e5dd-ad6b-436f-aa49-f16ad972b608 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:42 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.ca30e5dd-ad6b-436f-aa49-f16ad972b608 1G Jul 24 09:45:42 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:42 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-496268aa-c8ee-4b2c-9101-a37c90bcfa2e tempest-VolumesActionsTest-516935183 None] Terminate volume connection completed successfully. Jul 24 09:45:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-496268aa-c8ee-4b2c-9101-a37c90bcfa2e tempest-VolumesActionsTest-516935183 None] Acquiring lock "cinder-48d2cde3-4aa4-4edb-8fdf-f7f133f38988-detach_volume" by "detach_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-496268aa-c8ee-4b2c-9101-a37c90bcfa2e tempest-VolumesActionsTest-516935183 None] Lock "cinder-48d2cde3-4aa4-4edb-8fdf-f7f133f38988-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:42 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-496268aa-c8ee-4b2c-9101-a37c90bcfa2e tempest-VolumesActionsTest-516935183 None] Detaching volume 48d2cde3-4aa4-4edb-8fdf-f7f133f38988 from instance 9f57bb2b-9015-4c7a-8f6e-4dd6db11f75a. Jul 24 09:45:43 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-496268aa-c8ee-4b2c-9101-a37c90bcfa2e tempest-VolumesActionsTest-516935183 None] Detach volume completed successfully. Jul 24 09:45:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-496268aa-c8ee-4b2c-9101-a37c90bcfa2e tempest-VolumesActionsTest-516935183 None] Lock "cinder-48d2cde3-4aa4-4edb-8fdf-f7f133f38988-detach_volume" released by "detach_volume" :: held 0.154s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:43 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:45:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Flow 'volume_create_manager' (758aaf52-3391-4858-9f03-388a20c5cdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:45:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5da23a-a84e-42fb-8b7b-83bb86e21075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-bf2488c7-a258-49ff-9148-3a93f0a21711 tempest-VolumesActionsTest-813460047 None] Acquiring lock "cinder-48d2cde3-4aa4-4edb-8fdf-f7f133f38988-detach_volume" by "detach_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5da23a-a84e-42fb-8b7b-83bb86e21075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-790038893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19a8415-ed66-4f66-9c37-64b137209875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c19d58d924d41e4a649e8ddef65d160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:45:43Z,use_quota=True,user_id='9c0a9db0f6284650b14f1c7d23432287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04c98b74-4ece-4da3-b67d-e84a2bf38efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04c98b74-4ece-4da3-b67d-e84a2bf38efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee97db94-c126-450b-ad0f-e30cb887ebd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee97db94-c126-450b-ad0f-e30cb887ebd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f19a8415-ed66-4f66-9c37-64b137209875', 'volume_name': 'volume-f19a8415-ed66-4f66-9c37-64b137209875', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea10d15-611a-4ecc-846a-5bacb60ba68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea10d15-611a-4ecc-846a-5bacb60ba68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa12ac18-db13-4425-8853-10e0f3471dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:43 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Volume f19a8415-ed66-4f66-9c37-64b137209875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f19a8415-ed66-4f66-9c37-64b137209875', 'volume_size': 1} Jul 24 09:45:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:43 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3c2c2d84-30c3-41e0-b253-cc306d83df00 tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.ca30e5dd-ad6b-436f-aa49-f16ad972b608 1G" returned: 0 in 1.159s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3c2c2d84-30c3-41e0-b253-cc306d83df00 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.ca30e5dd-ad6b-436f-aa49-f16ad972b608 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-bf2488c7-a258-49ff-9148-3a93f0a21711 tempest-VolumesActionsTest-813460047 None] Lock "cinder-48d2cde3-4aa4-4edb-8fdf-f7f133f38988-detach_volume" acquired by "detach_volume" :: waited 0.089s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:43 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-bf2488c7-a258-49ff-9148-3a93f0a21711 tempest-VolumesActionsTest-813460047 None] Volume detach called, but volume not attached. Jul 24 09:45:43 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.ca30e5dd-ad6b-436f-aa49-f16ad972b608 Jul 24 09:45:43 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-bf2488c7-a258-49ff-9148-3a93f0a21711 tempest-VolumesActionsTest-813460047 None] Lock "cinder-48d2cde3-4aa4-4edb-8fdf-f7f133f38988-detach_volume" released by "detach_volume" :: held 0.058s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ada38ffc-6f4d-475b-b515-1707b04fae4b tempest-VolumesActionsTest-813460047 None] Acquiring lock "cinder-48d2cde3-4aa4-4edb-8fdf-f7f133f38988-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ada38ffc-6f4d-475b-b515-1707b04fae4b tempest-VolumesActionsTest-813460047 None] Lock "cinder-48d2cde3-4aa4-4edb-8fdf-f7f133f38988-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ada38ffc-6f4d-475b-b515-1707b04fae4b tempest-VolumesActionsTest-813460047 None] Acquiring lock "cinder-quobyte-48d2cde3-4aa4-4edb-8fdf-f7f133f38988" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ada38ffc-6f4d-475b-b515-1707b04fae4b tempest-VolumesActionsTest-813460047 None] Lock "cinder-quobyte-48d2cde3-4aa4-4edb-8fdf-f7f133f38988" acquired by "delete_volume" :: waited 0.052s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb273ef5-ee98-46f5-98c0-68b7080b8d85]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ada38ffc-6f4d-475b-b515-1707b04fae4b tempest-VolumesActionsTest-813460047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-48d2cde3-4aa4-4edb-8fdf-f7f133f38988 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:44 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3c2c2d84-30c3-41e0-b253-cc306d83df00 tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.ca30e5dd-ad6b-436f-aa49-f16ad972b608" returned: 0 in 0.585s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:44 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-3c2c2d84-30c3-41e0-b253-cc306d83df00 tempest-SnapshotsActionsTest-1429507181 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.ca30e5dd-ad6b-436f-aa49-f16ad972b608 is being set with open permissions: ugo+rw Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3c2c2d84-30c3-41e0-b253-cc306d83df00 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.ca30e5dd-ad6b-436f-aa49-f16ad972b608 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:44 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.ca30e5dd-ad6b-436f-aa49-f16ad972b608 Jul 24 09:45:44 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:44 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-48d2cde3-4aa4-4edb-8fdf-f7f133f38988 Jul 24 09:45:44 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:44 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3c2c2d84-30c3-41e0-b253-cc306d83df00 tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.ca30e5dd-ad6b-436f-aa49-f16ad972b608" returned: 0 in 0.464s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3c2c2d84-30c3-41e0-b253-cc306d83df00 tempest-SnapshotsActionsTest-1429507181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.371s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.159s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-790038893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19a8415-ed66-4f66-9c37-64b137209875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c19d58d924d41e4a649e8ddef65d160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:45:43Z,use_quota=True,user_id='9c0a9db0f6284650b14f1c7d23432287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Creating volume f19a8415-ed66-4f66-9c37-64b137209875 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:45:44 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f19a8415-ed66-4f66-9c37-64b137209875 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:44 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f19a8415-ed66-4f66-9c37-64b137209875 1073741824 Jul 24 09:45:44 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:44 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-3c2c2d84-30c3-41e0-b253-cc306d83df00 tempest-SnapshotsActionsTest-1429507181 None] Create snapshot completed successfully Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:45:44 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Flow 'volume_create_manager' (028ce9a2-a2e0-401c-8709-5ab1400996b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e74da774-d206-4c4a-85c9-f3c8579f697b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ada38ffc-6f4d-475b-b515-1707b04fae4b tempest-VolumesActionsTest-813460047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-48d2cde3-4aa4-4edb-8fdf-f7f133f38988" returned: 0 in 0.772s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ada38ffc-6f4d-475b-b515-1707b04fae4b tempest-VolumesActionsTest-813460047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-48d2cde3-4aa4-4edb-8fdf-f7f133f38988 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e74da774-d206-4c4a-85c9-f3c8579f697b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1835461857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3948e77-fd20-4704-9f25-e90ff48574e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b638f19f0c994353937ab3e78b4fe0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:45:45Z,use_quota=True,user_id='490b103b80694ba1b81834c352bb5b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b22274c6-29f1-4384-b741-38a9ffbd6e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:44 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-48d2cde3-4aa4-4edb-8fdf-f7f133f38988 Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b22274c6-29f1-4384-b741-38a9ffbd6e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:44 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bbb7119-3ddb-4234-adcf-b69eb4a25140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bbb7119-3ddb-4234-adcf-b69eb4a25140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3948e77-fd20-4704-9f25-e90ff48574e0', 'volume_name': 'volume-a3948e77-fd20-4704-9f25-e90ff48574e0', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b66f1ba3-c884-4093-a333-d72baf39d8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b66f1ba3-c884-4093-a333-d72baf39d8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09ff919-8caf-4521-acea-5df6cdb2f158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:44 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Volume a3948e77-fd20-4704-9f25-e90ff48574e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3948e77-fd20-4704-9f25-e90ff48574e0', 'volume_size': 1} Jul 24 09:45:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:45 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ada38ffc-6f4d-475b-b515-1707b04fae4b tempest-VolumesActionsTest-813460047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-48d2cde3-4aa4-4edb-8fdf-f7f133f38988" returned: 0 in 0.373s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ada38ffc-6f4d-475b-b515-1707b04fae4b tempest-VolumesActionsTest-813460047 None] Lock "cinder-quobyte-48d2cde3-4aa4-4edb-8fdf-f7f133f38988" released by "delete_volume" :: held 1.218s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-ada38ffc-6f4d-475b-b515-1707b04fae4b tempest-VolumesActionsTest-813460047 None] Created reservations ['e24cb5fd-843e-4a5d-8b1f-2b3834660cf3', '3c5ddf33-5de6-469d-833e-526c7d957d0c', '229760e8-2e3e-423b-89c4-909418b17edf', '9d3dbacb-8f38-4cf1-b285-57ebd0043515'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:45:45 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f19a8415-ed66-4f66-9c37-64b137209875 1073741824" returned: 0 in 0.696s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ada38ffc-6f4d-475b-b515-1707b04fae4b tempest-VolumesActionsTest-813460047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ada38ffc-6f4d-475b-b515-1707b04fae4b tempest-VolumesActionsTest-813460047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ada38ffc-6f4d-475b-b515-1707b04fae4b tempest-VolumesActionsTest-813460047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ada38ffc-6f4d-475b-b515-1707b04fae4b tempest-VolumesActionsTest-813460047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ada38ffc-6f4d-475b-b515-1707b04fae4b tempest-VolumesActionsTest-813460047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ada38ffc-6f4d-475b-b515-1707b04fae4b tempest-VolumesActionsTest-813460047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f19a8415-ed66-4f66-9c37-64b137209875 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:45 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:45:45 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:45 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f19a8415-ed66-4f66-9c37-64b137209875 Jul 24 09:45:45 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:45 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ada38ffc-6f4d-475b-b515-1707b04fae4b tempest-VolumesActionsTest-813460047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.401s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-ada38ffc-6f4d-475b-b515-1707b04fae4b tempest-VolumesActionsTest-813460047 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:45:45 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-ada38ffc-6f4d-475b-b515-1707b04fae4b tempest-VolumesActionsTest-813460047 None] Deleted volume successfully. Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ada38ffc-6f4d-475b-b515-1707b04fae4b tempest-VolumesActionsTest-813460047 None] Lock "cinder-48d2cde3-4aa4-4edb-8fdf-f7f133f38988-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:45 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f19a8415-ed66-4f66-9c37-64b137209875" returned: 0 in 0.459s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.969s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1835461857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3948e77-fd20-4704-9f25-e90ff48574e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b638f19f0c994353937ab3e78b4fe0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:45:45Z,use_quota=True,user_id='490b103b80694ba1b81834c352bb5b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Creating volume a3948e77-fd20-4704-9f25-e90ff48574e0 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:45:45 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:45:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3948e77-fd20-4704-9f25-e90ff48574e0 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:46 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3948e77-fd20-4704-9f25-e90ff48574e0 1073741824 Jul 24 09:45:46 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa12ac18-db13-4425-8853-10e0f3471dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f19a8415-ed66-4f66-9c37-64b137209875', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204e2c70-45d3-4f26-ae32-e402311ea5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:46 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Volume volume-f19a8415-ed66-4f66-9c37-64b137209875 (f19a8415-ed66-4f66-9c37-64b137209875): created successfully Jul 24 09:45:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204e2c70-45d3-4f26-ae32-e402311ea5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Flow 'volume_create_manager' (758aaf52-3391-4858-9f03-388a20c5cdfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:45:46 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-92d53b89-d158-4349-adf5-61dc85424bab tempest-TestMinimumBasicScenario-942645551 None] Created volume successfully. Jul 24 09:45:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] Acquiring lock "cinder-ca30e5dd-ad6b-436f-aa49-f16ad972b608-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-ca30e5dd-ad6b-436f-aa49-f16ad972b608-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] Acquiring lock "cinder-quobyte-565d18c5-a561-429e-b23e-31c40945dce1" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-quobyte-565d18c5-a561-429e-b23e-31c40945dce1" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] Acquiring lock "cinder-quobyte-ca30e5dd-ad6b-436f-aa49-f16ad972b608" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-quobyte-ca30e5dd-ad6b-436f-aa49-f16ad972b608" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] Deleting offline snapshot ca30e5dd-ad6b-436f-aa49-f16ad972b608 of volume 565d18c5-a561-429e-b23e-31c40945dce1 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:45:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] snapshot_file for this snap is: volume-565d18c5-a561-429e-b23e-31c40945dce1.ca30e5dd-ad6b-436f-aa49-f16ad972b608 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:45:46 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2bd70b-e76d-47a1-9862-a40358b73db7]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.ca30e5dd-ad6b-436f-aa49-f16ad972b608 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:46 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.ca30e5dd-ad6b-436f-aa49-f16ad972b608 Jul 24 09:45:46 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:46 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3948e77-fd20-4704-9f25-e90ff48574e0 1073741824" returned: 0 in 0.815s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3948e77-fd20-4704-9f25-e90ff48574e0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:46 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3948e77-fd20-4704-9f25-e90ff48574e0 Jul 24 09:45:46 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:47 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.ca30e5dd-ad6b-436f-aa49-f16ad972b608" returned: 0 in 0.752s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-565d18c5-a561-429e-b23e-31c40945dce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:45:47 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e4e99f-b558-4504-9c1b-d2f6a2539539]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:47 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 Jul 24 09:45:47 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:47 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3948e77-fd20-4704-9f25-e90ff48574e0" returned: 0 in 0.770s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:45:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09ff919-8caf-4521-acea-5df6cdb2f158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3948e77-fd20-4704-9f25-e90ff48574e0', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1208f9fe-8e08-4a57-a2fc-a9ad69fabb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:47 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Volume volume-a3948e77-fd20-4704-9f25-e90ff48574e0 (a3948e77-fd20-4704-9f25-e90ff48574e0): created successfully Jul 24 09:45:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1208f9fe-8e08-4a57-a2fc-a9ad69fabb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Flow 'volume_create_manager' (028ce9a2-a2e0-401c-8709-5ab1400996b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:45:47 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c4544573-f92d-44db-a43c-50c6f5ab3c5b tempest-VolumesListTestJSON-1853222172 None] Created volume successfully. Jul 24 09:45:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57" returned: 0 in 0.836s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-565d18c5-a561-429e-b23e-31c40945dce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:45:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.ca30e5dd-ad6b-436f-aa49-f16ad972b608 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:47 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:48 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.ca30e5dd-ad6b-436f-aa49-f16ad972b608 Jul 24 09:45:48 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-5317910f-e5d7-4c3d-9915-01bfba20360d req-92f4edd8-4b5f-4bd6-b5c3-94f9f3ebc234 tempest-TestMinimumBasicScenario-942645551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-5317910f-e5d7-4c3d-9915-01bfba20360d req-92f4edd8-4b5f-4bd6-b5c3-94f9f3ebc234 tempest-TestMinimumBasicScenario-942645551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-5317910f-e5d7-4c3d-9915-01bfba20360d req-92f4edd8-4b5f-4bd6-b5c3-94f9f3ebc234 tempest-TestMinimumBasicScenario-942645551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:48 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-5317910f-e5d7-4c3d-9915-01bfba20360d req-92f4edd8-4b5f-4bd6-b5c3-94f9f3ebc234 tempest-TestMinimumBasicScenario-942645551 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-f19a8415-ed66-4f66-9c37-64b137209875', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a488406b-177a-4c9f-a1ee-d7f746b774fb', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:45:48 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.ca30e5dd-ad6b-436f-aa49-f16ad972b608" returned: 0 in 0.847s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.ca30e5dd-ad6b-436f-aa49-f16ad972b608 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:48 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.ca30e5dd-ad6b-436f-aa49-f16ad972b608 Jul 24 09:45:48 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:48 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-5317910f-e5d7-4c3d-9915-01bfba20360d req-92f4edd8-4b5f-4bd6-b5c3-94f9f3ebc234 tempest-TestMinimumBasicScenario-942645551 None] attachment_update completed successfully. Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Flow 'volume_create_manager' (029cd2ac-6012-40fd-87c7-88688cebb40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f164d58-0e22-4037-abb5-fe9060250849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f164d58-0e22-4037-abb5-fe9060250849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-434489932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52955c8-2267-4159-b5ce-6cf31ecf3f27,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b638f19f0c994353937ab3e78b4fe0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:45:49Z,use_quota=True,user_id='490b103b80694ba1b81834c352bb5b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2656df57-0171-439f-acf0-1b998bb9d2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2656df57-0171-439f-acf0-1b998bb9d2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a45c003-2c84-4397-988f-6aba9af09dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a45c003-2c84-4397-988f-6aba9af09dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a52955c8-2267-4159-b5ce-6cf31ecf3f27', 'volume_name': 'volume-a52955c8-2267-4159-b5ce-6cf31ecf3f27', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5937387d-493d-4d9b-beec-80b25b5ea495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5937387d-493d-4d9b-beec-80b25b5ea495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3af7aa-a1f6-479c-8397-d7becf40189b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:49 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Volume a52955c8-2267-4159-b5ce-6cf31ecf3f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a52955c8-2267-4159-b5ce-6cf31ecf3f27', 'volume_size': 1} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-434489932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52955c8-2267-4159-b5ce-6cf31ecf3f27,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b638f19f0c994353937ab3e78b4fe0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:45:49Z,use_quota=True,user_id='490b103b80694ba1b81834c352bb5b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Creating volume a52955c8-2267-4159-b5ce-6cf31ecf3f27 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:45:49 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a52955c8-2267-4159-b5ce-6cf31ecf3f27 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:49 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a52955c8-2267-4159-b5ce-6cf31ecf3f27 1073741824 Jul 24 09:45:49 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:49 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.ca30e5dd-ad6b-436f-aa49-f16ad972b608" returned: 0 in 0.577s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-quobyte-ca30e5dd-ad6b-436f-aa49-f16ad972b608" released by "_delete_snapshot" :: held 3.195s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-quobyte-565d18c5-a561-429e-b23e-31c40945dce1" released by "delete_snapshot" :: held 3.231s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] Created reservations ['84fd87ee-2492-4bfb-b06f-1fc747995f93', '2c5cd623-ff5a-430d-9651-64f070af6e12', 'ec54ed1e-4065-4c95-b227-404a3cb7440b', '1a9121bc-3c13-4cda-af3c-d467ded4783d'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:45:49 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] Delete snapshot completed successfully. Jul 24 09:45:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6559bbf7-c651-4bf5-88ca-d799805599ba tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-ca30e5dd-ad6b-436f-aa49-f16ad972b608-delete_snapshot" released by "delete_snapshot" :: held 3.491s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:50 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a52955c8-2267-4159-b5ce-6cf31ecf3f27 1073741824" returned: 0 in 0.762s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a52955c8-2267-4159-b5ce-6cf31ecf3f27 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:50 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a52955c8-2267-4159-b5ce-6cf31ecf3f27 Jul 24 09:45:50 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:50 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a52955c8-2267-4159-b5ce-6cf31ecf3f27" returned: 0 in 0.309s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:50 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:45:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3af7aa-a1f6-479c-8397-d7becf40189b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a52955c8-2267-4159-b5ce-6cf31ecf3f27', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a0f8d80-4240-411e-a10e-82e002a9dfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:50 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Volume volume-a52955c8-2267-4159-b5ce-6cf31ecf3f27 (a52955c8-2267-4159-b5ce-6cf31ecf3f27): created successfully Jul 24 09:45:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a0f8d80-4240-411e-a10e-82e002a9dfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Flow 'volume_create_manager' (029cd2ac-6012-40fd-87c7-88688cebb40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:45:50 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-ef6a462f-4631-4813-84f6-2c790fee3c13 tempest-VolumesListTestJSON-1853222172 None] Created volume successfully. Jul 24 09:45:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-22d74805-a226-44e0-abed-84fc53c77526 tempest-SnapshotsActionsTest-1429507181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-22d74805-a226-44e0-abed-84fc53c77526 tempest-SnapshotsActionsTest-1429507181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:50 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-22d74805-a226-44e0-abed-84fc53c77526 tempest-SnapshotsActionsTest-1429507181 None] Creating offline snapshot 28c2f6aa-fc13-434c-940f-8aef176ffbe2 of volume 565d18c5-a561-429e-b23e-31c40945dce1 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:45:50 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6a2be5-1aaf-40fa-a24e-bf4467612a73]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-22d74805-a226-44e0-abed-84fc53c77526 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:51 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 Jul 24 09:45:51 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:51 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-22d74805-a226-44e0-abed-84fc53c77526 tempest-SnapshotsActionsTest-1429507181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57" returned: 0 in 0.444s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-22d74805-a226-44e0-abed-84fc53c77526 tempest-SnapshotsActionsTest-1429507181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-565d18c5-a561-429e-b23e-31c40945dce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:45:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-22d74805-a226-44e0-abed-84fc53c77526 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.28c2f6aa-fc13-434c-940f-8aef176ffbe2 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:51 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.28c2f6aa-fc13-434c-940f-8aef176ffbe2 1G Jul 24 09:45:51 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:52 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-22d74805-a226-44e0-abed-84fc53c77526 tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.28c2f6aa-fc13-434c-940f-8aef176ffbe2 1G" returned: 0 in 0.661s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-22d74805-a226-44e0-abed-84fc53c77526 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.28c2f6aa-fc13-434c-940f-8aef176ffbe2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:52 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.28c2f6aa-fc13-434c-940f-8aef176ffbe2 Jul 24 09:45:52 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Flow 'volume_create_manager' (bc00a040-ddae-4419-8d61-493f6572938f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18120e96-4b03-4070-a562-db9e373f63b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Flow 'volume_create_manager' (e9c797b0-19e9-4197-8ee0-cb704455d22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ad3ef6-5deb-4636-962d-61f611d65e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18120e96-4b03-4070-a562-db9e373f63b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1507433228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ff37e8-7bea-488a-bb5a-2459e7832d39,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b638f19f0c994353937ab3e78b4fe0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:45:52Z,use_quota=True,user_id='490b103b80694ba1b81834c352bb5b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fe2a28-6f51-4814-820b-8d93603ecc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fe2a28-6f51-4814-820b-8d93603ecc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e243ecd8-95d5-4d06-99ff-c54301ccb17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e243ecd8-95d5-4d06-99ff-c54301ccb17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77ff37e8-7bea-488a-bb5a-2459e7832d39', 'volume_name': 'volume-77ff37e8-7bea-488a-bb5a-2459e7832d39', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15ca844-1880-4eaf-898a-d18f2741dd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15ca844-1880-4eaf-898a-d18f2741dd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55815ec-ff48-4242-a0cb-9a99afec5c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:52 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Volume 77ff37e8-7bea-488a-bb5a-2459e7832d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77ff37e8-7bea-488a-bb5a-2459e7832d39', 'volume_size': 1} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ad3ef6-5deb-4636-962d-61f611d65e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1035892781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d549604-3c25-4d3f-97c2-68378522dffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764557bb570c433381b71042b55f619a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:45:52Z,use_quota=True,user_id='bf0034602c7c45b288c615d64e9513f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8fa241-efca-4f3c-8ca2-6a5a92fad971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8fa241-efca-4f3c-8ca2-6a5a92fad971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c895897c-c977-424b-8ce9-82a607266673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c895897c-c977-424b-8ce9-82a607266673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d549604-3c25-4d3f-97c2-68378522dffe', 'volume_name': 'volume-4d549604-3c25-4d3f-97c2-68378522dffe', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33695492-5e29-4af8-a858-f86c61669e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33695492-5e29-4af8-a858-f86c61669e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82aabd9f-ff25-406c-8ee3-08dcbbe45731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:52 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Volume 4d549604-3c25-4d3f-97c2-68378522dffe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d549604-3c25-4d3f-97c2-68378522dffe', 'volume_size': 1} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:52 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-22d74805-a226-44e0-abed-84fc53c77526 tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.28c2f6aa-fc13-434c-940f-8aef176ffbe2" returned: 0 in 0.448s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:52 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-22d74805-a226-44e0-abed-84fc53c77526 tempest-SnapshotsActionsTest-1429507181 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.28c2f6aa-fc13-434c-940f-8aef176ffbe2 is being set with open permissions: ugo+rw Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-22d74805-a226-44e0-abed-84fc53c77526 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.28c2f6aa-fc13-434c-940f-8aef176ffbe2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:52 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.28c2f6aa-fc13-434c-940f-8aef176ffbe2 Jul 24 09:45:52 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:52 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-22d74805-a226-44e0-abed-84fc53c77526 tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.28c2f6aa-fc13-434c-940f-8aef176ffbe2" returned: 0 in 0.272s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-22d74805-a226-44e0-abed-84fc53c77526 tempest-SnapshotsActionsTest-1429507181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.540s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1507433228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ff37e8-7bea-488a-bb5a-2459e7832d39,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b638f19f0c994353937ab3e78b4fe0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:45:52Z,use_quota=True,user_id='490b103b80694ba1b81834c352bb5b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Creating volume 77ff37e8-7bea-488a-bb5a-2459e7832d39 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:45:52 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:45:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-77ff37e8-7bea-488a-bb5a-2459e7832d39 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:52 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-77ff37e8-7bea-488a-bb5a-2459e7832d39 1073741824 Jul 24 09:45:52 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:52 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-22d74805-a226-44e0-abed-84fc53c77526 tempest-SnapshotsActionsTest-1429507181 None] Create snapshot completed successfully Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] Acquiring lock "cinder-28c2f6aa-fc13-434c-940f-8aef176ffbe2-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-28c2f6aa-fc13-434c-940f-8aef176ffbe2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.079s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] Acquiring lock "cinder-quobyte-565d18c5-a561-429e-b23e-31c40945dce1" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-quobyte-565d18c5-a561-429e-b23e-31c40945dce1" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] Acquiring lock "cinder-quobyte-28c2f6aa-fc13-434c-940f-8aef176ffbe2" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-quobyte-28c2f6aa-fc13-434c-940f-8aef176ffbe2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] Deleting offline snapshot 28c2f6aa-fc13-434c-940f-8aef176ffbe2 of volume 565d18c5-a561-429e-b23e-31c40945dce1 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] snapshot_file for this snap is: volume-565d18c5-a561-429e-b23e-31c40945dce1.28c2f6aa-fc13-434c-940f-8aef176ffbe2 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d4dbb3-c893-478c-96a5-74b9386a22a8]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.28c2f6aa-fc13-434c-940f-8aef176ffbe2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:53 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-77ff37e8-7bea-488a-bb5a-2459e7832d39 1073741824" returned: 0 in 0.588s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-77ff37e8-7bea-488a-bb5a-2459e7832d39 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:53 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.28c2f6aa-fc13-434c-940f-8aef176ffbe2 Jul 24 09:45:53 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-77ff37e8-7bea-488a-bb5a-2459e7832d39 Jul 24 09:45:53 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:53 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:53 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-77ff37e8-7bea-488a-bb5a-2459e7832d39" returned: 0 in 0.371s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.515s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1035892781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d549604-3c25-4d3f-97c2-68378522dffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764557bb570c433381b71042b55f619a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:45:52Z,use_quota=True,user_id='bf0034602c7c45b288c615d64e9513f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Creating volume 4d549604-3c25-4d3f-97c2-68378522dffe {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:45:53 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4d549604-3c25-4d3f-97c2-68378522dffe 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:53 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.28c2f6aa-fc13-434c-940f-8aef176ffbe2" returned: 0 in 0.544s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-565d18c5-a561-429e-b23e-31c40945dce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:45:53 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4d549604-3c25-4d3f-97c2-68378522dffe 1073741824 Jul 24 09:45:53 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55815ec-ff48-4242-a0cb-9a99afec5c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77ff37e8-7bea-488a-bb5a-2459e7832d39', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e80e3085-8757-4902-b4e5-2ea974fef90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c322e74-3cb7-45e4-ac36-3e29a0f63773]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:53 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Volume volume-77ff37e8-7bea-488a-bb5a-2459e7832d39 (77ff37e8-7bea-488a-bb5a-2459e7832d39): created successfully Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e80e3085-8757-4902-b4e5-2ea974fef90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Flow 'volume_create_manager' (bc00a040-ddae-4419-8d61-493f6572938f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:45:54 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-f0266365-d1ae-432b-8c51-89d14869d389 tempest-VolumesListTestJSON-1853222172 None] Created volume successfully. Jul 24 09:45:54 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 Jul 24 09:45:54 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:54 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57" returned: 0 in 0.536s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-565d18c5-a561-429e-b23e-31c40945dce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:45:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.28c2f6aa-fc13-434c-940f-8aef176ffbe2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:54 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4d549604-3c25-4d3f-97c2-68378522dffe 1073741824" returned: 0 in 0.660s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:54 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.28c2f6aa-fc13-434c-940f-8aef176ffbe2 Jul 24 09:45:54 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4d549604-3c25-4d3f-97c2-68378522dffe {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:54 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4d549604-3c25-4d3f-97c2-68378522dffe Jul 24 09:45:54 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:54 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4d549604-3c25-4d3f-97c2-68378522dffe" returned: 0 in 0.356s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:45:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:54 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82aabd9f-ff25-406c-8ee3-08dcbbe45731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d549604-3c25-4d3f-97c2-68378522dffe', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:54 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4427f9e3-157d-4674-bf32-74196e674dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:54 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Volume volume-4d549604-3c25-4d3f-97c2-68378522dffe (4d549604-3c25-4d3f-97c2-68378522dffe): created successfully Jul 24 09:45:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4427f9e3-157d-4674-bf32-74196e674dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Flow 'volume_create_manager' (e9c797b0-19e9-4197-8ee0-cb704455d22d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:45:55 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-a444e0ab-6f24-490c-ac92-67ef8ee6a4a0 tempest-VolumesActionsTest-813460047 None] Created volume successfully. Jul 24 09:45:55 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.28c2f6aa-fc13-434c-940f-8aef176ffbe2" returned: 0 in 0.602s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.28c2f6aa-fc13-434c-940f-8aef176ffbe2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:55 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.28c2f6aa-fc13-434c-940f-8aef176ffbe2 Jul 24 09:45:55 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:55 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.28c2f6aa-fc13-434c-940f-8aef176ffbe2" returned: 0 in 0.306s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:55 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-quobyte-28c2f6aa-fc13-434c-940f-8aef176ffbe2" released by "_delete_snapshot" :: held 2.113s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:55 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-quobyte-565d18c5-a561-429e-b23e-31c40945dce1" released by "delete_snapshot" :: held 2.141s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:55 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] Created reservations ['688d8a98-5cbe-40f6-a12b-7c9c4d861c46', '5d8878f6-03ef-4c31-be6a-de5449f776d2', '99fc99d7-f760-4119-92d1-f92289002719', 'bc49f410-2d26-4a2b-9b20-6abaebed47a7'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:45:55 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] Delete snapshot completed successfully. Jul 24 09:45:55 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e9f4c99-b65b-4673-84bf-88d395d7bdeb tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-28c2f6aa-fc13-434c-940f-8aef176ffbe2-delete_snapshot" released by "delete_snapshot" :: held 2.356s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4def74fc-e966-4757-933d-ade1421e78ab tempest-VolumesActionsTest-516935183 None] Acquiring lock "cinder-4d549604-3c25-4d3f-97c2-68378522dffe-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4def74fc-e966-4757-933d-ade1421e78ab tempest-VolumesActionsTest-516935183 None] Lock "cinder-4d549604-3c25-4d3f-97c2-68378522dffe-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4def74fc-e966-4757-933d-ade1421e78ab tempest-VolumesActionsTest-516935183 None] Acquiring lock "cinder-quobyte-4d549604-3c25-4d3f-97c2-68378522dffe" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4def74fc-e966-4757-933d-ade1421e78ab tempest-VolumesActionsTest-516935183 None] Lock "cinder-quobyte-4d549604-3c25-4d3f-97c2-68378522dffe" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:56 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc767024-f7d0-4fb7-a3b1-c78e0e8c0935]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4def74fc-e966-4757-933d-ade1421e78ab tempest-VolumesActionsTest-516935183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4d549604-3c25-4d3f-97c2-68378522dffe {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:56 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4d549604-3c25-4d3f-97c2-68378522dffe Jul 24 09:45:56 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d886eb45-8117-42d5-b5e3-b3220d7957bf tempest-SnapshotsActionsTest-1429507181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d886eb45-8117-42d5-b5e3-b3220d7957bf tempest-SnapshotsActionsTest-1429507181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-d886eb45-8117-42d5-b5e3-b3220d7957bf tempest-SnapshotsActionsTest-1429507181 None] Creating offline snapshot c0e92d7b-4e4d-4f57-a24d-4702fc55c11f of volume 565d18c5-a561-429e-b23e-31c40945dce1 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[53db3844-43f3-42fb-b567-11f4f5193fdf]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d886eb45-8117-42d5-b5e3-b3220d7957bf tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:57 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 Jul 24 09:45:57 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:57 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4def74fc-e966-4757-933d-ade1421e78ab tempest-VolumesActionsTest-516935183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4d549604-3c25-4d3f-97c2-68378522dffe" returned: 0 in 0.534s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4def74fc-e966-4757-933d-ade1421e78ab tempest-VolumesActionsTest-516935183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4d549604-3c25-4d3f-97c2-68378522dffe {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:57 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4d549604-3c25-4d3f-97c2-68378522dffe Jul 24 09:45:57 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:57 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d886eb45-8117-42d5-b5e3-b3220d7957bf tempest-SnapshotsActionsTest-1429507181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57" returned: 0 in 0.454s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-d886eb45-8117-42d5-b5e3-b3220d7957bf tempest-SnapshotsActionsTest-1429507181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-565d18c5-a561-429e-b23e-31c40945dce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d886eb45-8117-42d5-b5e3-b3220d7957bf tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.c0e92d7b-4e4d-4f57-a24d-4702fc55c11f 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:57 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.c0e92d7b-4e4d-4f57-a24d-4702fc55c11f 1G Jul 24 09:45:57 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:57 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4def74fc-e966-4757-933d-ade1421e78ab tempest-VolumesActionsTest-516935183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4d549604-3c25-4d3f-97c2-68378522dffe" returned: 0 in 0.365s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4def74fc-e966-4757-933d-ade1421e78ab tempest-VolumesActionsTest-516935183 None] Lock "cinder-quobyte-4d549604-3c25-4d3f-97c2-68378522dffe" released by "delete_volume" :: held 0.975s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=84,cinder:UPDATE=87,cinder:DELETE=8,cinder:INSERT=23 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-4def74fc-e966-4757-933d-ade1421e78ab tempest-VolumesActionsTest-516935183 None] Created reservations ['e3599179-281c-4ef0-a7e6-dc9bee9c75cd', 'badf68d8-13a8-40e9-afd9-127c30d3f922', 'd4ad849a-d266-49c8-9383-de6083586655', '5afbea87-f8bb-406d-b468-608d19fd27fd'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4def74fc-e966-4757-933d-ade1421e78ab tempest-VolumesActionsTest-516935183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4def74fc-e966-4757-933d-ade1421e78ab tempest-VolumesActionsTest-516935183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4def74fc-e966-4757-933d-ade1421e78ab tempest-VolumesActionsTest-516935183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4def74fc-e966-4757-933d-ade1421e78ab tempest-VolumesActionsTest-516935183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4def74fc-e966-4757-933d-ade1421e78ab tempest-VolumesActionsTest-516935183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4def74fc-e966-4757-933d-ade1421e78ab tempest-VolumesActionsTest-516935183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:57 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:45:57 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-00b62516-6420-43e4-b223-125021bed88a tempest-VolumesListTestJSON-1853222172 None] Acquiring lock "cinder-77ff37e8-7bea-488a-bb5a-2459e7832d39-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-00b62516-6420-43e4-b223-125021bed88a tempest-VolumesListTestJSON-1853222172 None] Lock "cinder-77ff37e8-7bea-488a-bb5a-2459e7832d39-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-00b62516-6420-43e4-b223-125021bed88a tempest-VolumesListTestJSON-1853222172 None] Acquiring lock "cinder-quobyte-77ff37e8-7bea-488a-bb5a-2459e7832d39" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-00b62516-6420-43e4-b223-125021bed88a tempest-VolumesListTestJSON-1853222172 None] Lock "cinder-quobyte-77ff37e8-7bea-488a-bb5a-2459e7832d39" acquired by "delete_volume" :: waited 0.023s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0f4fec-2621-4d65-8143-145b2f2c9e55]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-00b62516-6420-43e4-b223-125021bed88a tempest-VolumesListTestJSON-1853222172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-77ff37e8-7bea-488a-bb5a-2459e7832d39 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:58 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4def74fc-e966-4757-933d-ade1421e78ab tempest-VolumesActionsTest-516935183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.356s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-4def74fc-e966-4757-933d-ade1421e78ab tempest-VolumesActionsTest-516935183 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:45:58 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-77ff37e8-7bea-488a-bb5a-2459e7832d39 Jul 24 09:45:58 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:58 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-4def74fc-e966-4757-933d-ade1421e78ab tempest-VolumesActionsTest-516935183 None] Deleted volume successfully. Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=112,cinder:INSERT=21,cinder:SELECT=98,cinder:DELETE=9 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:45:58 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d886eb45-8117-42d5-b5e3-b3220d7957bf tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.c0e92d7b-4e4d-4f57-a24d-4702fc55c11f 1G" returned: 0 in 0.655s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d886eb45-8117-42d5-b5e3-b3220d7957bf tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.c0e92d7b-4e4d-4f57-a24d-4702fc55c11f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:58 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.c0e92d7b-4e4d-4f57-a24d-4702fc55c11f Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4def74fc-e966-4757-933d-ade1421e78ab tempest-VolumesActionsTest-516935183 None] Lock "cinder-4d549604-3c25-4d3f-97c2-68378522dffe-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:58 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:58 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-00b62516-6420-43e4-b223-125021bed88a tempest-VolumesListTestJSON-1853222172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-77ff37e8-7bea-488a-bb5a-2459e7832d39" returned: 0 in 0.419s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-00b62516-6420-43e4-b223-125021bed88a tempest-VolumesListTestJSON-1853222172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-77ff37e8-7bea-488a-bb5a-2459e7832d39 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:58 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-77ff37e8-7bea-488a-bb5a-2459e7832d39 Jul 24 09:45:58 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:58 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d886eb45-8117-42d5-b5e3-b3220d7957bf tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.c0e92d7b-4e4d-4f57-a24d-4702fc55c11f" returned: 0 in 0.314s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:58 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-d886eb45-8117-42d5-b5e3-b3220d7957bf tempest-SnapshotsActionsTest-1429507181 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.c0e92d7b-4e4d-4f57-a24d-4702fc55c11f is being set with open permissions: ugo+rw Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d886eb45-8117-42d5-b5e3-b3220d7957bf tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.c0e92d7b-4e4d-4f57-a24d-4702fc55c11f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:58 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.c0e92d7b-4e4d-4f57-a24d-4702fc55c11f Jul 24 09:45:58 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:58 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-00b62516-6420-43e4-b223-125021bed88a tempest-VolumesListTestJSON-1853222172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-77ff37e8-7bea-488a-bb5a-2459e7832d39" returned: 0 in 0.301s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-00b62516-6420-43e4-b223-125021bed88a tempest-VolumesListTestJSON-1853222172 None] Lock "cinder-quobyte-77ff37e8-7bea-488a-bb5a-2459e7832d39" released by "delete_volume" :: held 0.772s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:58 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d886eb45-8117-42d5-b5e3-b3220d7957bf tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.c0e92d7b-4e4d-4f57-a24d-4702fc55c11f" returned: 0 in 0.291s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d886eb45-8117-42d5-b5e3-b3220d7957bf tempest-SnapshotsActionsTest-1429507181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.852s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:58 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d886eb45-8117-42d5-b5e3-b3220d7957bf tempest-SnapshotsActionsTest-1429507181 None] Create snapshot completed successfully Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-00b62516-6420-43e4-b223-125021bed88a tempest-VolumesListTestJSON-1853222172 None] Created reservations ['4bfedfde-0ecf-41c6-8101-dfa7ac312716', 'f82c565c-7d38-49f9-b6fd-fd1cabfeaeef', '4c8eb82e-908d-4f63-ad77-eb1a367ee13d', '6f0751aa-efd9-4fb1-a419-b1d08fa2c788'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-00b62516-6420-43e4-b223-125021bed88a tempest-VolumesListTestJSON-1853222172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-00b62516-6420-43e4-b223-125021bed88a tempest-VolumesListTestJSON-1853222172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-00b62516-6420-43e4-b223-125021bed88a tempest-VolumesListTestJSON-1853222172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-00b62516-6420-43e4-b223-125021bed88a tempest-VolumesListTestJSON-1853222172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-00b62516-6420-43e4-b223-125021bed88a tempest-VolumesListTestJSON-1853222172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-00b62516-6420-43e4-b223-125021bed88a tempest-VolumesListTestJSON-1853222172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:58 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:45:58 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5e0f70a4-9aab-4bb5-98ba-2619b4fe57fd tempest-VolumesListTestJSON-1853222172 None] Acquiring lock "cinder-a52955c8-2267-4159-b5ce-6cf31ecf3f27-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5e0f70a4-9aab-4bb5-98ba-2619b4fe57fd tempest-VolumesListTestJSON-1853222172 None] Lock "cinder-a52955c8-2267-4159-b5ce-6cf31ecf3f27-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5e0f70a4-9aab-4bb5-98ba-2619b4fe57fd tempest-VolumesListTestJSON-1853222172 None] Acquiring lock "cinder-quobyte-a52955c8-2267-4159-b5ce-6cf31ecf3f27" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5e0f70a4-9aab-4bb5-98ba-2619b4fe57fd tempest-VolumesListTestJSON-1853222172 None] Lock "cinder-quobyte-a52955c8-2267-4159-b5ce-6cf31ecf3f27" acquired by "delete_volume" :: waited 0.028s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4c52dc-bc94-4c97-a760-4a9324465076]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5e0f70a4-9aab-4bb5-98ba-2619b4fe57fd tempest-VolumesListTestJSON-1853222172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a52955c8-2267-4159-b5ce-6cf31ecf3f27 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:59 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-00b62516-6420-43e4-b223-125021bed88a tempest-VolumesListTestJSON-1853222172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.557s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-00b62516-6420-43e4-b223-125021bed88a tempest-VolumesListTestJSON-1853222172 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:45:59 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-00b62516-6420-43e4-b223-125021bed88a tempest-VolumesListTestJSON-1853222172 None] Deleted volume successfully. Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-00b62516-6420-43e4-b223-125021bed88a tempest-VolumesListTestJSON-1853222172 None] Lock "cinder-77ff37e8-7bea-488a-bb5a-2459e7832d39-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] Acquiring lock "cinder-c0e92d7b-4e4d-4f57-a24d-4702fc55c11f-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-c0e92d7b-4e4d-4f57-a24d-4702fc55c11f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] Acquiring lock "cinder-quobyte-565d18c5-a561-429e-b23e-31c40945dce1" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-quobyte-565d18c5-a561-429e-b23e-31c40945dce1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] Acquiring lock "cinder-quobyte-c0e92d7b-4e4d-4f57-a24d-4702fc55c11f" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-quobyte-c0e92d7b-4e4d-4f57-a24d-4702fc55c11f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] Deleting offline snapshot c0e92d7b-4e4d-4f57-a24d-4702fc55c11f of volume 565d18c5-a561-429e-b23e-31c40945dce1 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:45:59 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a52955c8-2267-4159-b5ce-6cf31ecf3f27 Jul 24 09:45:59 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] snapshot_file for this snap is: volume-565d18c5-a561-429e-b23e-31c40945dce1.c0e92d7b-4e4d-4f57-a24d-4702fc55c11f {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5314fc2-6f51-43a6-934e-dcc43dc93247]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.c0e92d7b-4e4d-4f57-a24d-4702fc55c11f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Flow 'volume_create_manager' (fb5bfd1c-aa0a-4f8a-89f4-03d7810659a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96e94fc-4f59-4d2e-a098-db662062ad4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96e94fc-4f59-4d2e-a098-db662062ad4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1652828644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=226432e2-eb2a-4232-b63e-a19e0d18c7ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764557bb570c433381b71042b55f619a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:00Z,use_quota=True,user_id='bf0034602c7c45b288c615d64e9513f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86455bd1-9606-480d-82cd-39c0c66e247f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86455bd1-9606-480d-82cd-39c0c66e247f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7540c10-7c3a-4cb1-a5e8-232b7691c911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7540c10-7c3a-4cb1-a5e8-232b7691c911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '226432e2-eb2a-4232-b63e-a19e0d18c7ea', 'volume_name': 'volume-226432e2-eb2a-4232-b63e-a19e0d18c7ea', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d11522-dbb5-459d-a351-56a741d92401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d11522-dbb5-459d-a351-56a741d92401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26bd46e0-684e-4d5b-adcf-0aa8dcf30aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:45:59 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Volume 226432e2-eb2a-4232-b63e-a19e0d18c7ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-226432e2-eb2a-4232-b63e-a19e0d18c7ea', 'volume_size': 1} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1652828644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=226432e2-eb2a-4232-b63e-a19e0d18c7ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764557bb570c433381b71042b55f619a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:00Z,use_quota=True,user_id='bf0034602c7c45b288c615d64e9513f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Creating volume 226432e2-eb2a-4232-b63e-a19e0d18c7ea {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:45:59 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-226432e2-eb2a-4232-b63e-a19e0d18c7ea 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:59 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.c0e92d7b-4e4d-4f57-a24d-4702fc55c11f Jul 24 09:45:59 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:59 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-226432e2-eb2a-4232-b63e-a19e0d18c7ea 1073741824 Jul 24 09:45:59 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:45:59 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5e0f70a4-9aab-4bb5-98ba-2619b4fe57fd tempest-VolumesListTestJSON-1853222172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a52955c8-2267-4159-b5ce-6cf31ecf3f27" returned: 0 in 0.441s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:45:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5e0f70a4-9aab-4bb5-98ba-2619b4fe57fd tempest-VolumesListTestJSON-1853222172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a52955c8-2267-4159-b5ce-6cf31ecf3f27 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:45:59 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a52955c8-2267-4159-b5ce-6cf31ecf3f27 Jul 24 09:45:59 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:00 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.c0e92d7b-4e4d-4f57-a24d-4702fc55c11f" returned: 0 in 0.398s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-565d18c5-a561-429e-b23e-31c40945dce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9250e12a-ff97-4f8c-b8f9-4060b70082b4]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:00 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5e0f70a4-9aab-4bb5-98ba-2619b4fe57fd tempest-VolumesListTestJSON-1853222172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a52955c8-2267-4159-b5ce-6cf31ecf3f27" returned: 0 in 0.260s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5e0f70a4-9aab-4bb5-98ba-2619b4fe57fd tempest-VolumesListTestJSON-1853222172 None] Lock "cinder-quobyte-a52955c8-2267-4159-b5ce-6cf31ecf3f27" released by "delete_volume" :: held 0.758s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:00 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 Jul 24 09:46:00 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-5e0f70a4-9aab-4bb5-98ba-2619b4fe57fd tempest-VolumesListTestJSON-1853222172 None] Created reservations ['584d45ca-2fa1-49d6-9ab2-3b4c5e8cca2c', 'f38b2b8c-89eb-48ee-bd59-a7703dc59c57', 'c4c11e32-1de3-4c3c-ae29-39c4febe81b2', '1eee14d9-a24b-4b6b-96ba-792917e4604e'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:46:00 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-226432e2-eb2a-4232-b63e-a19e0d18c7ea 1073741824" returned: 0 in 0.488s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-226432e2-eb2a-4232-b63e-a19e0d18c7ea {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5e0f70a4-9aab-4bb5-98ba-2619b4fe57fd tempest-VolumesListTestJSON-1853222172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5e0f70a4-9aab-4bb5-98ba-2619b4fe57fd tempest-VolumesListTestJSON-1853222172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-5e0f70a4-9aab-4bb5-98ba-2619b4fe57fd tempest-VolumesListTestJSON-1853222172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-5e0f70a4-9aab-4bb5-98ba-2619b4fe57fd tempest-VolumesListTestJSON-1853222172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5e0f70a4-9aab-4bb5-98ba-2619b4fe57fd tempest-VolumesListTestJSON-1853222172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:00 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-226432e2-eb2a-4232-b63e-a19e0d18c7ea Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5e0f70a4-9aab-4bb5-98ba-2619b4fe57fd tempest-VolumesListTestJSON-1853222172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:00 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:00 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:46:00 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:00 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57" returned: 0 in 0.401s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-565d18c5-a561-429e-b23e-31c40945dce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.c0e92d7b-4e4d-4f57-a24d-4702fc55c11f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:00 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.c0e92d7b-4e4d-4f57-a24d-4702fc55c11f Jul 24 09:46:00 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:00 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-428795d0-8db9-4a4a-a342-5d2d74ae45e9 tempest-VolumesListTestJSON-1853222172 None] Acquiring lock "cinder-a3948e77-fd20-4704-9f25-e90ff48574e0-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-226432e2-eb2a-4232-b63e-a19e0d18c7ea" returned: 0 in 0.312s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:00 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5e0f70a4-9aab-4bb5-98ba-2619b4fe57fd tempest-VolumesListTestJSON-1853222172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.300s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-5e0f70a4-9aab-4bb5-98ba-2619b4fe57fd tempest-VolumesListTestJSON-1853222172 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-428795d0-8db9-4a4a-a342-5d2d74ae45e9 tempest-VolumesListTestJSON-1853222172 None] Lock "cinder-a3948e77-fd20-4704-9f25-e90ff48574e0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:00 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-5e0f70a4-9aab-4bb5-98ba-2619b4fe57fd tempest-VolumesListTestJSON-1853222172 None] Deleted volume successfully. Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26bd46e0-684e-4d5b-adcf-0aa8dcf30aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-226432e2-eb2a-4232-b63e-a19e0d18c7ea', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (623b5627-def8-4768-ab8e-ff3131afbf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:00 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Volume volume-226432e2-eb2a-4232-b63e-a19e0d18c7ea (226432e2-eb2a-4232-b63e-a19e0d18c7ea): created successfully Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (623b5627-def8-4768-ab8e-ff3131afbf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Flow 'volume_create_manager' (fb5bfd1c-aa0a-4f8a-89f4-03d7810659a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5e0f70a4-9aab-4bb5-98ba-2619b4fe57fd tempest-VolumesListTestJSON-1853222172 None] Lock "cinder-a52955c8-2267-4159-b5ce-6cf31ecf3f27-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:00 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-ba4ee0b1-8056-4e39-9a19-4d7e4e0c0e4a tempest-VolumesActionsTest-813460047 None] Created volume successfully. Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-428795d0-8db9-4a4a-a342-5d2d74ae45e9 tempest-VolumesListTestJSON-1853222172 None] Acquiring lock "cinder-quobyte-a3948e77-fd20-4704-9f25-e90ff48574e0" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-428795d0-8db9-4a4a-a342-5d2d74ae45e9 tempest-VolumesListTestJSON-1853222172 None] Lock "cinder-quobyte-a3948e77-fd20-4704-9f25-e90ff48574e0" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15e79a7-f707-4995-a742-b48da187def1]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-428795d0-8db9-4a4a-a342-5d2d74ae45e9 tempest-VolumesListTestJSON-1853222172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3948e77-fd20-4704-9f25-e90ff48574e0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:00 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3948e77-fd20-4704-9f25-e90ff48574e0 Jul 24 09:46:00 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:00 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.c0e92d7b-4e4d-4f57-a24d-4702fc55c11f" returned: 0 in 0.454s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.c0e92d7b-4e4d-4f57-a24d-4702fc55c11f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:00 devstack sudo[99597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.c0e92d7b-4e4d-4f57-a24d-4702fc55c11f Jul 24 09:46:00 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:01 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-428795d0-8db9-4a4a-a342-5d2d74ae45e9 tempest-VolumesListTestJSON-1853222172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3948e77-fd20-4704-9f25-e90ff48574e0" returned: 0 in 0.381s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-428795d0-8db9-4a4a-a342-5d2d74ae45e9 tempest-VolumesListTestJSON-1853222172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3948e77-fd20-4704-9f25-e90ff48574e0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:01 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3948e77-fd20-4704-9f25-e90ff48574e0 Jul 24 09:46:01 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:01 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.c0e92d7b-4e4d-4f57-a24d-4702fc55c11f" returned: 0 in 0.264s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-quobyte-c0e92d7b-4e4d-4f57-a24d-4702fc55c11f" released by "_delete_snapshot" :: held 1.625s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-quobyte-565d18c5-a561-429e-b23e-31c40945dce1" released by "delete_snapshot" :: held 1.657s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] Created reservations ['f9e83c36-07a1-408d-8d26-376975095e3d', '860ed536-0ac4-4437-88e9-c8fa38af99fc', 'd33a3ae6-2d2a-434b-893b-aa08ce3946b6', 'fe47f54e-968d-4cd4-8941-681bf586cc84'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:46:01 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] Delete snapshot completed successfully. Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1537ded1-dc22-463e-b5ce-fe7250dd4262 tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-c0e92d7b-4e4d-4f57-a24d-4702fc55c11f-delete_snapshot" released by "delete_snapshot" :: held 1.823s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:01 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-428795d0-8db9-4a4a-a342-5d2d74ae45e9 tempest-VolumesListTestJSON-1853222172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3948e77-fd20-4704-9f25-e90ff48574e0" returned: 0 in 0.250s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-428795d0-8db9-4a4a-a342-5d2d74ae45e9 tempest-VolumesListTestJSON-1853222172 None] Lock "cinder-quobyte-a3948e77-fd20-4704-9f25-e90ff48574e0" released by "delete_volume" :: held 0.665s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-428795d0-8db9-4a4a-a342-5d2d74ae45e9 tempest-VolumesListTestJSON-1853222172 None] Created reservations ['7f1bfc02-3038-4d78-801e-529db7f4b491', '0ad4df80-f6fd-4a03-8694-0dc2ffc56e28', 'bb6b7682-e579-445d-9238-66cffd9a820d', '08f8ec4e-bc5d-43ac-91e5-fde897445ab4'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-428795d0-8db9-4a4a-a342-5d2d74ae45e9 tempest-VolumesListTestJSON-1853222172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-428795d0-8db9-4a4a-a342-5d2d74ae45e9 tempest-VolumesListTestJSON-1853222172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-428795d0-8db9-4a4a-a342-5d2d74ae45e9 tempest-VolumesListTestJSON-1853222172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-428795d0-8db9-4a4a-a342-5d2d74ae45e9 tempest-VolumesListTestJSON-1853222172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-428795d0-8db9-4a4a-a342-5d2d74ae45e9 tempest-VolumesListTestJSON-1853222172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-428795d0-8db9-4a4a-a342-5d2d74ae45e9 tempest-VolumesListTestJSON-1853222172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:01 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:46:01 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:01 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-428795d0-8db9-4a4a-a342-5d2d74ae45e9 tempest-VolumesListTestJSON-1853222172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.261s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-428795d0-8db9-4a4a-a342-5d2d74ae45e9 tempest-VolumesListTestJSON-1853222172 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:46:01 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-428795d0-8db9-4a4a-a342-5d2d74ae45e9 tempest-VolumesListTestJSON-1853222172 None] Deleted volume successfully. Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-428795d0-8db9-4a4a-a342-5d2d74ae45e9 tempest-VolumesListTestJSON-1853222172 None] Lock "cinder-a3948e77-fd20-4704-9f25-e90ff48574e0-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0b401325-a63b-4f5b-9ea0-6a0ae16678d9 tempest-VolumesActionsTest-516935183 None] Acquiring lock "cinder-226432e2-eb2a-4232-b63e-a19e0d18c7ea-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0b401325-a63b-4f5b-9ea0-6a0ae16678d9 tempest-VolumesActionsTest-516935183 None] Lock "cinder-226432e2-eb2a-4232-b63e-a19e0d18c7ea-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0b401325-a63b-4f5b-9ea0-6a0ae16678d9 tempest-VolumesActionsTest-516935183 None] Acquiring lock "cinder-quobyte-226432e2-eb2a-4232-b63e-a19e0d18c7ea" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0b401325-a63b-4f5b-9ea0-6a0ae16678d9 tempest-VolumesActionsTest-516935183 None] Lock "cinder-quobyte-226432e2-eb2a-4232-b63e-a19e0d18c7ea" acquired by "delete_volume" :: waited 0.026s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:02 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[914697f8-bcfe-40af-a322-187e3c5fa385]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0b401325-a63b-4f5b-9ea0-6a0ae16678d9 tempest-VolumesActionsTest-516935183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-226432e2-eb2a-4232-b63e-a19e0d18c7ea {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:02 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-226432e2-eb2a-4232-b63e-a19e0d18c7ea Jul 24 09:46:02 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3367dff1-e873-4996-a685-c55406516d36 tempest-SnapshotsActionsTest-1429507181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3367dff1-e873-4996-a685-c55406516d36 tempest-SnapshotsActionsTest-1429507181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-3367dff1-e873-4996-a685-c55406516d36 tempest-SnapshotsActionsTest-1429507181 None] Creating offline snapshot 028774ba-3bdb-4d35-a4d8-c804e6d550eb of volume 565d18c5-a561-429e-b23e-31c40945dce1 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:46:02 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a33645-37be-4044-943c-22574d1a7e96]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3367dff1-e873-4996-a685-c55406516d36 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:02 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0b401325-a63b-4f5b-9ea0-6a0ae16678d9 tempest-VolumesActionsTest-516935183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-226432e2-eb2a-4232-b63e-a19e0d18c7ea" returned: 0 in 0.504s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0b401325-a63b-4f5b-9ea0-6a0ae16678d9 tempest-VolumesActionsTest-516935183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-226432e2-eb2a-4232-b63e-a19e0d18c7ea {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:02 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 Jul 24 09:46:02 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:02 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-226432e2-eb2a-4232-b63e-a19e0d18c7ea Jul 24 09:46:02 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:02 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0b401325-a63b-4f5b-9ea0-6a0ae16678d9 tempest-VolumesActionsTest-516935183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-226432e2-eb2a-4232-b63e-a19e0d18c7ea" returned: 0 in 0.310s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:02 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0b401325-a63b-4f5b-9ea0-6a0ae16678d9 tempest-VolumesActionsTest-516935183 None] Lock "cinder-quobyte-226432e2-eb2a-4232-b63e-a19e0d18c7ea" released by "delete_volume" :: held 0.897s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:02 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3367dff1-e873-4996-a685-c55406516d36 tempest-SnapshotsActionsTest-1429507181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57" returned: 0 in 0.481s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-3367dff1-e873-4996-a685-c55406516d36 tempest-SnapshotsActionsTest-1429507181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-565d18c5-a561-429e-b23e-31c40945dce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:46:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3367dff1-e873-4996-a685-c55406516d36 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.028774ba-3bdb-4d35-a4d8-c804e6d550eb 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:02 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.028774ba-3bdb-4d35-a4d8-c804e6d550eb 1G Jul 24 09:46:02 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:02 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-0b401325-a63b-4f5b-9ea0-6a0ae16678d9 tempest-VolumesActionsTest-516935183 None] Created reservations ['c302ca4e-200a-440c-bc20-dc73b260dd09', '4df5a04f-ed6d-41b1-a0ac-e408c644f418', '0b66ed45-be6e-4a4e-b7e5-6e280b1f6723', 'ed491373-26dd-438a-8042-69966b13b3be'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0b401325-a63b-4f5b-9ea0-6a0ae16678d9 tempest-VolumesActionsTest-516935183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0b401325-a63b-4f5b-9ea0-6a0ae16678d9 tempest-VolumesActionsTest-516935183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0b401325-a63b-4f5b-9ea0-6a0ae16678d9 tempest-VolumesActionsTest-516935183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0b401325-a63b-4f5b-9ea0-6a0ae16678d9 tempest-VolumesActionsTest-516935183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0b401325-a63b-4f5b-9ea0-6a0ae16678d9 tempest-VolumesActionsTest-516935183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0b401325-a63b-4f5b-9ea0-6a0ae16678d9 tempest-VolumesActionsTest-516935183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:03 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:46:03 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:03 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0b401325-a63b-4f5b-9ea0-6a0ae16678d9 tempest-VolumesActionsTest-516935183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.338s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-0b401325-a63b-4f5b-9ea0-6a0ae16678d9 tempest-VolumesActionsTest-516935183 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:46:03 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-0b401325-a63b-4f5b-9ea0-6a0ae16678d9 tempest-VolumesActionsTest-516935183 None] Deleted volume successfully. Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0b401325-a63b-4f5b-9ea0-6a0ae16678d9 tempest-VolumesActionsTest-516935183 None] Lock "cinder-226432e2-eb2a-4232-b63e-a19e0d18c7ea-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:03 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3367dff1-e873-4996-a685-c55406516d36 tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.028774ba-3bdb-4d35-a4d8-c804e6d550eb 1G" returned: 0 in 0.810s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3367dff1-e873-4996-a685-c55406516d36 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.028774ba-3bdb-4d35-a4d8-c804e6d550eb {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:03 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.028774ba-3bdb-4d35-a4d8-c804e6d550eb Jul 24 09:46:03 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Flow 'volume_create_manager' (b9231b71-7353-481b-9490-4d4a002db417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f759c1-6cf4-4e88-9780-9a44357db474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f759c1-6cf4-4e88-9780-9a44357db474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-786028113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764557bb570c433381b71042b55f619a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:04Z,use_quota=True,user_id='bf0034602c7c45b288c615d64e9513f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4c51c5-ec30-4ca5-a63a-a8a91e6e9461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4c51c5-ec30-4ca5-a63a-a8a91e6e9461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (268c83d3-6c54-47a1-95bd-2d64140e7a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (268c83d3-6c54-47a1-95bd-2d64140e7a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57', 'volume_name': 'volume-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63889fbc-eb71-4211-877b-e62133c22044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63889fbc-eb71-4211-877b-e62133c22044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:04 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd9495d7-dc40-40c8-989d-a70f32541e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:04 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Volume a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57', 'volume_size': 1} Jul 24 09:46:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:04 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3367dff1-e873-4996-a685-c55406516d36 tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.028774ba-3bdb-4d35-a4d8-c804e6d550eb" returned: 0 in 0.399s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:04 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-3367dff1-e873-4996-a685-c55406516d36 tempest-SnapshotsActionsTest-1429507181 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.028774ba-3bdb-4d35-a4d8-c804e6d550eb is being set with open permissions: ugo+rw Jul 24 09:46:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3367dff1-e873-4996-a685-c55406516d36 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.028774ba-3bdb-4d35-a4d8-c804e6d550eb {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:04 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.028774ba-3bdb-4d35-a4d8-c804e6d550eb Jul 24 09:46:04 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:04 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3367dff1-e873-4996-a685-c55406516d36 tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.028774ba-3bdb-4d35-a4d8-c804e6d550eb" returned: 0 in 0.265s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3367dff1-e873-4996-a685-c55406516d36 tempest-SnapshotsActionsTest-1429507181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.094s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.419s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-786028113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764557bb570c433381b71042b55f619a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:04Z,use_quota=True,user_id='bf0034602c7c45b288c615d64e9513f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:46:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Creating volume a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:46:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:46:04 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:46:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:04 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57 1073741824 Jul 24 09:46:04 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:04 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-3367dff1-e873-4996-a685-c55406516d36 tempest-SnapshotsActionsTest-1429507181 None] Create snapshot completed successfully Jul 24 09:46:04 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57 1073741824" returned: 0 in 0.517s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:05 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57 Jul 24 09:46:05 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:05 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57" returned: 0 in 0.291s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd9495d7-dc40-40c8-989d-a70f32541e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56119651-7d8f-4514-bb5b-70081cfba817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:05 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Volume volume-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57 (a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57): created successfully Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56119651-7d8f-4514-bb5b-70081cfba817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Flow 'volume_create_manager' (b9231b71-7353-481b-9490-4d4a002db417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:05 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c77b8151-1dfb-4dcf-bf56-9d37af2c04f6 tempest-VolumesActionsTest-813460047 None] Created volume successfully. Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Flow 'volume_create_manager' (eeb5c8f0-ac81-432e-ae2e-c800a6611905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (091477ac-01c0-4dd9-8420-3c6496abb79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] Acquiring lock "cinder-028774ba-3bdb-4d35-a4d8-c804e6d550eb-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (091477ac-01c0-4dd9-8420-3c6496abb79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1113250162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13680f7d-9bdb-4386-b7a4-f1243b71fee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3035326077cb4a1ebf5ef87647c370cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:06Z,use_quota=True,user_id='bcbeb2c8f10a4d3995cb0f16d89c234d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32cff0d2-8f21-4620-97db-3e84c88d632e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32cff0d2-8f21-4620-97db-3e84c88d632e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ca7af2-24b6-4938-88dd-1fd8bac4f6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ca7af2-24b6-4938-88dd-1fd8bac4f6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13680f7d-9bdb-4386-b7a4-f1243b71fee4', 'volume_name': 'volume-13680f7d-9bdb-4386-b7a4-f1243b71fee4', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c401e941-db0c-442f-9712-e1e90c9d8890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c401e941-db0c-442f-9712-e1e90c9d8890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b52a5b6-941d-43fa-abf6-4ec197df32ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:05 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Volume 13680f7d-9bdb-4386-b7a4-f1243b71fee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13680f7d-9bdb-4386-b7a4-f1243b71fee4', 'volume_size': 1} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1113250162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13680f7d-9bdb-4386-b7a4-f1243b71fee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3035326077cb4a1ebf5ef87647c370cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:06Z,use_quota=True,user_id='bcbeb2c8f10a4d3995cb0f16d89c234d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Creating volume 13680f7d-9bdb-4386-b7a4-f1243b71fee4 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:46:05 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-13680f7d-9bdb-4386-b7a4-f1243b71fee4 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-028774ba-3bdb-4d35-a4d8-c804e6d550eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.082s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] Acquiring lock "cinder-quobyte-565d18c5-a561-429e-b23e-31c40945dce1" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:05 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-13680f7d-9bdb-4386-b7a4-f1243b71fee4 1073741824 Jul 24 09:46:05 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-quobyte-565d18c5-a561-429e-b23e-31c40945dce1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] Acquiring lock "cinder-quobyte-028774ba-3bdb-4d35-a4d8-c804e6d550eb" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-quobyte-028774ba-3bdb-4d35-a4d8-c804e6d550eb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] Deleting offline snapshot 028774ba-3bdb-4d35-a4d8-c804e6d550eb of volume 565d18c5-a561-429e-b23e-31c40945dce1 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] snapshot_file for this snap is: volume-565d18c5-a561-429e-b23e-31c40945dce1.028774ba-3bdb-4d35-a4d8-c804e6d550eb {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[94742fdb-095b-441b-95fe-eaface84e8c6]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.028774ba-3bdb-4d35-a4d8-c804e6d550eb {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:06 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.028774ba-3bdb-4d35-a4d8-c804e6d550eb Jul 24 09:46:06 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fc29ff2a-2339-4e47-933e-d2d07740bfa6 tempest-VolumesActionsTest-516935183 None] Acquiring lock "cinder-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fc29ff2a-2339-4e47-933e-d2d07740bfa6 tempest-VolumesActionsTest-516935183 None] Lock "cinder-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fc29ff2a-2339-4e47-933e-d2d07740bfa6 tempest-VolumesActionsTest-516935183 None] Acquiring lock "cinder-quobyte-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fc29ff2a-2339-4e47-933e-d2d07740bfa6 tempest-VolumesActionsTest-516935183 None] Lock "cinder-quobyte-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57" acquired by "delete_volume" :: waited 0.020s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd17126-27ec-42a6-a212-42c3c7125236]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fc29ff2a-2339-4e47-933e-d2d07740bfa6 tempest-VolumesActionsTest-516935183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:06 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-13680f7d-9bdb-4386-b7a4-f1243b71fee4 1073741824" returned: 0 in 0.576s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-13680f7d-9bdb-4386-b7a4-f1243b71fee4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:06 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.028774ba-3bdb-4d35-a4d8-c804e6d550eb" returned: 0 in 0.523s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-565d18c5-a561-429e-b23e-31c40945dce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:46:06 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-13680f7d-9bdb-4386-b7a4-f1243b71fee4 Jul 24 09:46:06 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[083813f4-cad9-4fa3-9b69-54db656db324]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:06 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57 Jul 24 09:46:06 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:06 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 Jul 24 09:46:06 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:06 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-13680f7d-9bdb-4386-b7a4-f1243b71fee4" returned: 0 in 0.287s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b52a5b6-941d-43fa-abf6-4ec197df32ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13680f7d-9bdb-4386-b7a4-f1243b71fee4', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e82513-5b85-4936-8d0e-d3fe3481a626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:06 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Volume volume-13680f7d-9bdb-4386-b7a4-f1243b71fee4 (13680f7d-9bdb-4386-b7a4-f1243b71fee4): created successfully Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e82513-5b85-4936-8d0e-d3fe3481a626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Flow 'volume_create_manager' (eeb5c8f0-ac81-432e-ae2e-c800a6611905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fc29ff2a-2339-4e47-933e-d2d07740bfa6 tempest-VolumesActionsTest-516935183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57" returned: 0 in 0.412s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:06 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fc29ff2a-2339-4e47-933e-d2d07740bfa6 tempest-VolumesActionsTest-516935183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:06 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-ed074670-caa0-4b2e-a18a-6f728ee0bf76 tempest-VolumesNegativeTest-981031237 None] Created volume successfully. Jul 24 09:46:06 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57 Jul 24 09:46:06 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:06 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57" returned: 0 in 0.380s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-565d18c5-a561-429e-b23e-31c40945dce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:46:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.028774ba-3bdb-4d35-a4d8-c804e6d550eb {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:06 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.028774ba-3bdb-4d35-a4d8-c804e6d550eb Jul 24 09:46:06 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:07 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fc29ff2a-2339-4e47-933e-d2d07740bfa6 tempest-VolumesActionsTest-516935183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57" returned: 0 in 0.269s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fc29ff2a-2339-4e47-933e-d2d07740bfa6 tempest-VolumesActionsTest-516935183 None] Lock "cinder-quobyte-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57" released by "delete_volume" :: held 0.733s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-fc29ff2a-2339-4e47-933e-d2d07740bfa6 tempest-VolumesActionsTest-516935183 None] Created reservations ['39007ea2-4a06-48c6-84ed-46d674c9c185', 'd00503d9-86d8-461b-97a1-e975e4cc17ee', '537e70ff-7319-476a-8f5e-fd049e464940', '24dc69dc-a868-4e8b-9684-a7754801a2fb'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fc29ff2a-2339-4e47-933e-d2d07740bfa6 tempest-VolumesActionsTest-516935183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fc29ff2a-2339-4e47-933e-d2d07740bfa6 tempest-VolumesActionsTest-516935183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fc29ff2a-2339-4e47-933e-d2d07740bfa6 tempest-VolumesActionsTest-516935183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fc29ff2a-2339-4e47-933e-d2d07740bfa6 tempest-VolumesActionsTest-516935183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fc29ff2a-2339-4e47-933e-d2d07740bfa6 tempest-VolumesActionsTest-516935183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fc29ff2a-2339-4e47-933e-d2d07740bfa6 tempest-VolumesActionsTest-516935183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:07 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:46:07 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:07 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.028774ba-3bdb-4d35-a4d8-c804e6d550eb" returned: 0 in 0.403s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.028774ba-3bdb-4d35-a4d8-c804e6d550eb {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:07 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.028774ba-3bdb-4d35-a4d8-c804e6d550eb Jul 24 09:46:07 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:07 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fc29ff2a-2339-4e47-933e-d2d07740bfa6 tempest-VolumesActionsTest-516935183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.252s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-fc29ff2a-2339-4e47-933e-d2d07740bfa6 tempest-VolumesActionsTest-516935183 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:46:07 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-fc29ff2a-2339-4e47-933e-d2d07740bfa6 tempest-VolumesActionsTest-516935183 None] Deleted volume successfully. Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fc29ff2a-2339-4e47-933e-d2d07740bfa6 tempest-VolumesActionsTest-516935183 None] Lock "cinder-a98cd3dd-d0d1-4b49-94b1-a1dfd3882a57-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:07 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.028774ba-3bdb-4d35-a4d8-c804e6d550eb" returned: 0 in 0.268s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-quobyte-028774ba-3bdb-4d35-a4d8-c804e6d550eb" released by "_delete_snapshot" :: held 1.718s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-quobyte-565d18c5-a561-429e-b23e-31c40945dce1" released by "delete_snapshot" :: held 1.752s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] Created reservations ['b7202856-edfb-4280-bb82-a364c868003d', '462dc028-2a7f-4253-aa6e-ac2a13fc72b7', '4f829aee-85d4-4c70-8d50-9a2071bfd17d', '8670bc2d-0303-4328-98cf-1578e143a366'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:46:07 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] Delete snapshot completed successfully. Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cd035c57-ceaf-4fe7-858d-e4d24fc5417d tempest-SnapshotsActionsTest-886100998 None] Lock "cinder-028774ba-3bdb-4d35-a4d8-c804e6d550eb-delete_snapshot" released by "delete_snapshot" :: held 1.923s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Flow 'volume_create_manager' (2423460e-dfc1-4d11-9bce-1d0c31a17c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f93664-66bd-4a99-809b-546401555714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f93664-66bd-4a99-809b-546401555714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-669619513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c70858-108d-4eb6-ba8e-382e37b592e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764557bb570c433381b71042b55f619a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:08Z,use_quota=True,user_id='bf0034602c7c45b288c615d64e9513f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2ad5ba-d3a8-4b29-93fa-45632058ef72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2ad5ba-d3a8-4b29-93fa-45632058ef72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36c070d-6445-4ca9-8bf5-28dfd8d33e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36c070d-6445-4ca9-8bf5-28dfd8d33e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1c70858-108d-4eb6-ba8e-382e37b592e0', 'volume_name': 'volume-e1c70858-108d-4eb6-ba8e-382e37b592e0', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297c518f-99ad-4d27-b422-1c171c05ec9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297c518f-99ad-4d27-b422-1c171c05ec9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411303c0-9807-409f-b3c3-edd1a2b4d3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:08 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Volume e1c70858-108d-4eb6-ba8e-382e37b592e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1c70858-108d-4eb6-ba8e-382e37b592e0', 'volume_size': 1} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-669619513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c70858-108d-4eb6-ba8e-382e37b592e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764557bb570c433381b71042b55f619a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:08Z,use_quota=True,user_id='bf0034602c7c45b288c615d64e9513f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Creating volume e1c70858-108d-4eb6-ba8e-382e37b592e0 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:46:08 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e1c70858-108d-4eb6-ba8e-382e37b592e0 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:08 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e1c70858-108d-4eb6-ba8e-382e37b592e0 1073741824 Jul 24 09:46:08 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] Acquiring lock "cinder-9972c10d-b3d5-49ac-89bb-ad29012f3c57-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] Lock "cinder-9972c10d-b3d5-49ac-89bb-ad29012f3c57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] Acquiring lock "cinder-quobyte-565d18c5-a561-429e-b23e-31c40945dce1" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] Lock "cinder-quobyte-565d18c5-a561-429e-b23e-31c40945dce1" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] Acquiring lock "cinder-quobyte-9972c10d-b3d5-49ac-89bb-ad29012f3c57" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] Lock "cinder-quobyte-9972c10d-b3d5-49ac-89bb-ad29012f3c57" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] Deleting offline snapshot 9972c10d-b3d5-49ac-89bb-ad29012f3c57 of volume 565d18c5-a561-429e-b23e-31c40945dce1 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] snapshot_file for this snap is: volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce77d75e-f644-476f-9e67-e4a237a88803]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:08 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 Jul 24 09:46:08 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:08 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e1c70858-108d-4eb6-ba8e-382e37b592e0 1073741824" returned: 0 in 0.598s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e1c70858-108d-4eb6-ba8e-382e37b592e0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:08 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e1c70858-108d-4eb6-ba8e-382e37b592e0 Jul 24 09:46:08 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:08 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57" returned: 0 in 0.452s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-565d18c5-a561-429e-b23e-31c40945dce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6763aa8a-f600-46d0-9ca0-e7ed06668cc2]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:09 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e1c70858-108d-4eb6-ba8e-382e37b592e0" returned: 0 in 0.314s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:46:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411303c0-9807-409f-b3c3-edd1a2b4d3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c70858-108d-4eb6-ba8e-382e37b592e0', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc092e03-23e0-475d-b0a7-465fd9f7e39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:09 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Volume volume-e1c70858-108d-4eb6-ba8e-382e37b592e0 (e1c70858-108d-4eb6-ba8e-382e37b592e0): created successfully Jul 24 09:46:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc092e03-23e0-475d-b0a7-465fd9f7e39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:09 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1 Jul 24 09:46:09 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Flow 'volume_create_manager' (2423460e-dfc1-4d11-9bce-1d0c31a17c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:09 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-26538324-17ae-48a7-9f4f-0254917ff11e tempest-VolumesActionsTest-813460047 None] Created volume successfully. Jul 24 09:46:09 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1" returned: 0 in 0.394s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:09 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 Jul 24 09:46:09 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:09 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57" returned: 0 in 0.453s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:09 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57 Jul 24 09:46:09 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:10 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1.9972c10d-b3d5-49ac-89bb-ad29012f3c57" returned: 0 in 0.342s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] Lock "cinder-quobyte-9972c10d-b3d5-49ac-89bb-ad29012f3c57" released by "_delete_snapshot" :: held 1.812s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] Lock "cinder-quobyte-565d18c5-a561-429e-b23e-31c40945dce1" released by "delete_snapshot" :: held 1.850s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7e6dee30-4473-4023-a92f-47cf1778db57 tempest-VolumesActionsTest-516935183 None] Acquiring lock "cinder-e1c70858-108d-4eb6-ba8e-382e37b592e0-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:10 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] Created reservations ['f87278b3-c37f-48e3-83ae-875ba91a594f', '6db6be75-30f2-45f1-a3fd-3273555dbf86', '812a9e05-e91a-44d3-883b-bcc139a3ce32', '81104f8f-aecb-4e4d-b956-c84fdfc32961'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:46:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7e6dee30-4473-4023-a92f-47cf1778db57 tempest-VolumesActionsTest-516935183 None] Lock "cinder-e1c70858-108d-4eb6-ba8e-382e37b592e0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7e6dee30-4473-4023-a92f-47cf1778db57 tempest-VolumesActionsTest-516935183 None] Acquiring lock "cinder-quobyte-e1c70858-108d-4eb6-ba8e-382e37b592e0" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7e6dee30-4473-4023-a92f-47cf1778db57 tempest-VolumesActionsTest-516935183 None] Lock "cinder-quobyte-e1c70858-108d-4eb6-ba8e-382e37b592e0" acquired by "delete_volume" :: waited 0.045s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:10 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7f7124-bb0c-4ca4-9bdd-4cac6e74d12c]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7e6dee30-4473-4023-a92f-47cf1778db57 tempest-VolumesActionsTest-516935183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e1c70858-108d-4eb6-ba8e-382e37b592e0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:10 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] Delete snapshot completed successfully. Jul 24 09:46:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d700b2f4-efbd-454d-a7a7-87fc97a2eec0 tempest-SnapshotsActionsTest-1429507181 None] Lock "cinder-9972c10d-b3d5-49ac-89bb-ad29012f3c57-delete_snapshot" released by "delete_snapshot" :: held 2.259s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-62934215-199f-4177-8450-8eb97d726711 tempest-SnapshotsActionsTest-1429507181 None] Acquiring lock "cinder-565d18c5-a561-429e-b23e-31c40945dce1-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-62934215-199f-4177-8450-8eb97d726711 tempest-SnapshotsActionsTest-1429507181 None] Lock "cinder-565d18c5-a561-429e-b23e-31c40945dce1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-62934215-199f-4177-8450-8eb97d726711 tempest-SnapshotsActionsTest-1429507181 None] Acquiring lock "cinder-quobyte-565d18c5-a561-429e-b23e-31c40945dce1" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:10 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e1c70858-108d-4eb6-ba8e-382e37b592e0 Jul 24 09:46:10 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-62934215-199f-4177-8450-8eb97d726711 tempest-SnapshotsActionsTest-1429507181 None] Lock "cinder-quobyte-565d18c5-a561-429e-b23e-31c40945dce1" acquired by "delete_volume" :: waited 0.030s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:10 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be77924-37da-4bed-8254-45c932fd5743]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-62934215-199f-4177-8450-8eb97d726711 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:11 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1 Jul 24 09:46:11 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:11 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7e6dee30-4473-4023-a92f-47cf1778db57 tempest-VolumesActionsTest-516935183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e1c70858-108d-4eb6-ba8e-382e37b592e0" returned: 0 in 0.722s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7e6dee30-4473-4023-a92f-47cf1778db57 tempest-VolumesActionsTest-516935183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e1c70858-108d-4eb6-ba8e-382e37b592e0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:11 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e1c70858-108d-4eb6-ba8e-382e37b592e0 Jul 24 09:46:11 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:11 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-62934215-199f-4177-8450-8eb97d726711 tempest-SnapshotsActionsTest-1429507181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1" returned: 0 in 0.601s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-62934215-199f-4177-8450-8eb97d726711 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:11 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1 Jul 24 09:46:11 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:11 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7e6dee30-4473-4023-a92f-47cf1778db57 tempest-VolumesActionsTest-516935183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e1c70858-108d-4eb6-ba8e-382e37b592e0" returned: 0 in 0.340s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7e6dee30-4473-4023-a92f-47cf1778db57 tempest-VolumesActionsTest-516935183 None] Lock "cinder-quobyte-e1c70858-108d-4eb6-ba8e-382e37b592e0" released by "delete_volume" :: held 1.149s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:11 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-7e6dee30-4473-4023-a92f-47cf1778db57 tempest-VolumesActionsTest-516935183 None] Created reservations ['1f439b7b-4e7e-41cb-9c2f-8510c2cdf2ad', '02d87956-4be4-47f5-bf62-d73a34660abd', '07d2fd35-3d83-4ed9-9bbf-8aa11cd8fe42', '4042c2e1-6cdd-4e3c-9042-11c401364a26'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:46:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7e6dee30-4473-4023-a92f-47cf1778db57 tempest-VolumesActionsTest-516935183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7e6dee30-4473-4023-a92f-47cf1778db57 tempest-VolumesActionsTest-516935183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7e6dee30-4473-4023-a92f-47cf1778db57 tempest-VolumesActionsTest-516935183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:11 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7e6dee30-4473-4023-a92f-47cf1778db57 tempest-VolumesActionsTest-516935183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7e6dee30-4473-4023-a92f-47cf1778db57 tempest-VolumesActionsTest-516935183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7e6dee30-4473-4023-a92f-47cf1778db57 tempest-VolumesActionsTest-516935183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-62934215-199f-4177-8450-8eb97d726711 tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-565d18c5-a561-429e-b23e-31c40945dce1" returned: 0 in 0.364s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:11 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:46:11 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-62934215-199f-4177-8450-8eb97d726711 tempest-SnapshotsActionsTest-1429507181 None] Lock "cinder-quobyte-565d18c5-a561-429e-b23e-31c40945dce1" released by "delete_volume" :: held 1.115s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:12 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-62934215-199f-4177-8450-8eb97d726711 tempest-SnapshotsActionsTest-1429507181 None] Created reservations ['ceca19e0-1294-48c4-af40-3367b0a351f5', '412162b5-0d5e-4e2f-8886-8c3e73a65e55', '585ab356-d339-4ac0-b8cd-9b8cd75ec018', '1165799c-0c94-42cd-8e07-b6f05c7547d4'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:46:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-62934215-199f-4177-8450-8eb97d726711 tempest-SnapshotsActionsTest-1429507181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-62934215-199f-4177-8450-8eb97d726711 tempest-SnapshotsActionsTest-1429507181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-62934215-199f-4177-8450-8eb97d726711 tempest-SnapshotsActionsTest-1429507181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-62934215-199f-4177-8450-8eb97d726711 tempest-SnapshotsActionsTest-1429507181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-62934215-199f-4177-8450-8eb97d726711 tempest-SnapshotsActionsTest-1429507181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-62934215-199f-4177-8450-8eb97d726711 tempest-SnapshotsActionsTest-1429507181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:12 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:46:12 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:12 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7e6dee30-4473-4023-a92f-47cf1778db57 tempest-VolumesActionsTest-516935183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.526s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:12 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-7e6dee30-4473-4023-a92f-47cf1778db57 tempest-VolumesActionsTest-516935183 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:46:12 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-7e6dee30-4473-4023-a92f-47cf1778db57 tempest-VolumesActionsTest-516935183 None] Deleted volume successfully. Jul 24 09:46:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7e6dee30-4473-4023-a92f-47cf1778db57 tempest-VolumesActionsTest-516935183 None] Lock "cinder-e1c70858-108d-4eb6-ba8e-382e37b592e0-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:12 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-62934215-199f-4177-8450-8eb97d726711 tempest-SnapshotsActionsTest-1429507181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.526s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:12 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-62934215-199f-4177-8450-8eb97d726711 tempest-SnapshotsActionsTest-1429507181 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:46:12 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-62934215-199f-4177-8450-8eb97d726711 tempest-SnapshotsActionsTest-1429507181 None] Deleted volume successfully. Jul 24 09:46:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-62934215-199f-4177-8450-8eb97d726711 tempest-SnapshotsActionsTest-1429507181 None] Lock "cinder-565d18c5-a561-429e-b23e-31c40945dce1-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Flow 'volume_create_manager' (33f2f3e9-e09f-4271-b94f-7dea57366d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8beccd1-9737-4fc5-ad63-3d62a6a78042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8beccd1-9737-4fc5-ad63-3d62a6a78042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-336522993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a9e661-0179-4b3c-94c3-11c10c978960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764557bb570c433381b71042b55f619a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:13Z,use_quota=True,user_id='bf0034602c7c45b288c615d64e9513f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4a2fce-d560-458d-9e13-343242c6dfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4a2fce-d560-458d-9e13-343242c6dfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5482ef6-5fe3-4e31-a7a4-a71bbf214716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5482ef6-5fe3-4e31-a7a4-a71bbf214716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9a9e661-0179-4b3c-94c3-11c10c978960', 'volume_name': 'volume-f9a9e661-0179-4b3c-94c3-11c10c978960', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8010dabf-8308-4464-987e-a5f56dba27b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8010dabf-8308-4464-987e-a5f56dba27b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886ea89d-2106-4066-9464-65ce36be58c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:13 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Volume f9a9e661-0179-4b3c-94c3-11c10c978960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9a9e661-0179-4b3c-94c3-11c10c978960', 'volume_size': 1} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-336522993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a9e661-0179-4b3c-94c3-11c10c978960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764557bb570c433381b71042b55f619a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:13Z,use_quota=True,user_id='bf0034602c7c45b288c615d64e9513f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Creating volume f9a9e661-0179-4b3c-94c3-11c10c978960 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:46:13 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:46:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f9a9e661-0179-4b3c-94c3-11c10c978960 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:13 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f9a9e661-0179-4b3c-94c3-11c10c978960 1073741824 Jul 24 09:46:13 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:14 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f9a9e661-0179-4b3c-94c3-11c10c978960 1073741824" returned: 0 in 0.792s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f9a9e661-0179-4b3c-94c3-11c10c978960 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:14 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f9a9e661-0179-4b3c-94c3-11c10c978960 Jul 24 09:46:14 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:46:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:15 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:46:15 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:15 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f9a9e661-0179-4b3c-94c3-11c10c978960" returned: 0 in 0.699s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:46:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886ea89d-2106-4066-9464-65ce36be58c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a9e661-0179-4b3c-94c3-11c10c978960', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c1e849-858e-4459-b321-c26d6bd630ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:15 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Volume volume-f9a9e661-0179-4b3c-94c3-11c10c978960 (f9a9e661-0179-4b3c-94c3-11c10c978960): created successfully Jul 24 09:46:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c1e849-858e-4459-b321-c26d6bd630ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Flow 'volume_create_manager' (33f2f3e9-e09f-4271-b94f-7dea57366d30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:15 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-19b03bda-529a-4126-9d13-5a8e15ae672a tempest-VolumesActionsTest-813460047 None] Created volume successfully. Jul 24 09:46:15 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.730s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:46:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:46:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 28 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:46:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:46:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3f5a4564-e540-4e0f-be9e-84d404bf8382 tempest-VolumesActionsTest-813460047 None] Acquiring lock "cinder-f9a9e661-0179-4b3c-94c3-11c10c978960-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3f5a4564-e540-4e0f-be9e-84d404bf8382 tempest-VolumesActionsTest-813460047 None] Lock "cinder-f9a9e661-0179-4b3c-94c3-11c10c978960-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3f5a4564-e540-4e0f-be9e-84d404bf8382 tempest-VolumesActionsTest-813460047 None] Acquiring lock "cinder-quobyte-f9a9e661-0179-4b3c-94c3-11c10c978960" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3f5a4564-e540-4e0f-be9e-84d404bf8382 tempest-VolumesActionsTest-813460047 None] Lock "cinder-quobyte-f9a9e661-0179-4b3c-94c3-11c10c978960" acquired by "delete_volume" :: waited 0.041s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:17 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedeb972-9208-4df0-8e13-03246f2954c1]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3f5a4564-e540-4e0f-be9e-84d404bf8382 tempest-VolumesActionsTest-813460047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f9a9e661-0179-4b3c-94c3-11c10c978960 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:17 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f9a9e661-0179-4b3c-94c3-11c10c978960 Jul 24 09:46:17 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:17 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3f5a4564-e540-4e0f-be9e-84d404bf8382 tempest-VolumesActionsTest-813460047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f9a9e661-0179-4b3c-94c3-11c10c978960" returned: 0 in 0.534s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3f5a4564-e540-4e0f-be9e-84d404bf8382 tempest-VolumesActionsTest-813460047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f9a9e661-0179-4b3c-94c3-11c10c978960 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:17 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f9a9e661-0179-4b3c-94c3-11c10c978960 Jul 24 09:46:17 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:18 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3f5a4564-e540-4e0f-be9e-84d404bf8382 tempest-VolumesActionsTest-813460047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f9a9e661-0179-4b3c-94c3-11c10c978960" returned: 0 in 0.594s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:18 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3f5a4564-e540-4e0f-be9e-84d404bf8382 tempest-VolumesActionsTest-813460047 None] Lock "cinder-quobyte-f9a9e661-0179-4b3c-94c3-11c10c978960" released by "delete_volume" :: held 1.217s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:18 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-3f5a4564-e540-4e0f-be9e-84d404bf8382 tempest-VolumesActionsTest-813460047 None] Created reservations ['766e61e9-07a3-48db-886f-8587858d5e7b', '6eec75f8-b9e3-469d-b8fc-1fd64e802d30', '4bddf5ad-8a7f-43ab-b313-d5a05f6d5a46', 'bd07cc41-21af-465d-9b58-b80b8db56432'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:46:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3f5a4564-e540-4e0f-be9e-84d404bf8382 tempest-VolumesActionsTest-813460047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3f5a4564-e540-4e0f-be9e-84d404bf8382 tempest-VolumesActionsTest-813460047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3f5a4564-e540-4e0f-be9e-84d404bf8382 tempest-VolumesActionsTest-813460047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3f5a4564-e540-4e0f-be9e-84d404bf8382 tempest-VolumesActionsTest-813460047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3f5a4564-e540-4e0f-be9e-84d404bf8382 tempest-VolumesActionsTest-813460047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3f5a4564-e540-4e0f-be9e-84d404bf8382 tempest-VolumesActionsTest-813460047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:18 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:46:18 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:19 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3f5a4564-e540-4e0f-be9e-84d404bf8382 tempest-VolumesActionsTest-813460047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.366s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:19 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-3f5a4564-e540-4e0f-be9e-84d404bf8382 tempest-VolumesActionsTest-813460047 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:46:19 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-3f5a4564-e540-4e0f-be9e-84d404bf8382 tempest-VolumesActionsTest-813460047 None] Deleted volume successfully. Jul 24 09:46:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3f5a4564-e540-4e0f-be9e-84d404bf8382 tempest-VolumesActionsTest-813460047 None] Lock "cinder-f9a9e661-0179-4b3c-94c3-11c10c978960-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:28 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=67,cinder:UPDATE=90,cinder:INSERT=22,cinder:DELETE=5 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:46:29 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:INSERT=29,cinder:UPDATE=112,cinder:SELECT=71,cinder:DELETE=10 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:46:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b6330fb8-c306-418d-abb0-7c1d10ef5854 tempest-VolumesNegativeTest-981031237 None] Acquiring lock "cinder-13680f7d-9bdb-4386-b7a4-f1243b71fee4-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b6330fb8-c306-418d-abb0-7c1d10ef5854 tempest-VolumesNegativeTest-981031237 None] Lock "cinder-13680f7d-9bdb-4386-b7a4-f1243b71fee4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b6330fb8-c306-418d-abb0-7c1d10ef5854 tempest-VolumesNegativeTest-981031237 None] Acquiring lock "cinder-quobyte-13680f7d-9bdb-4386-b7a4-f1243b71fee4" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b6330fb8-c306-418d-abb0-7c1d10ef5854 tempest-VolumesNegativeTest-981031237 None] Lock "cinder-quobyte-13680f7d-9bdb-4386-b7a4-f1243b71fee4" acquired by "delete_volume" :: waited 0.029s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:34 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9a245d-056f-4b97-91a2-78410f25e698]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b6330fb8-c306-418d-abb0-7c1d10ef5854 tempest-VolumesNegativeTest-981031237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-13680f7d-9bdb-4386-b7a4-f1243b71fee4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:34 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-13680f7d-9bdb-4386-b7a4-f1243b71fee4 Jul 24 09:46:34 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:34 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b6330fb8-c306-418d-abb0-7c1d10ef5854 tempest-VolumesNegativeTest-981031237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-13680f7d-9bdb-4386-b7a4-f1243b71fee4" returned: 0 in 0.441s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b6330fb8-c306-418d-abb0-7c1d10ef5854 tempest-VolumesNegativeTest-981031237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-13680f7d-9bdb-4386-b7a4-f1243b71fee4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:34 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-13680f7d-9bdb-4386-b7a4-f1243b71fee4 Jul 24 09:46:34 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:34 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b6330fb8-c306-418d-abb0-7c1d10ef5854 tempest-VolumesNegativeTest-981031237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-13680f7d-9bdb-4386-b7a4-f1243b71fee4" returned: 0 in 0.311s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b6330fb8-c306-418d-abb0-7c1d10ef5854 tempest-VolumesNegativeTest-981031237 None] Lock "cinder-quobyte-13680f7d-9bdb-4386-b7a4-f1243b71fee4" released by "delete_volume" :: held 0.809s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:35 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-b6330fb8-c306-418d-abb0-7c1d10ef5854 tempest-VolumesNegativeTest-981031237 None] Created reservations ['05a5807f-bf80-4ced-a267-4f9af939198c', '55972059-3237-4ad5-a846-9df109b8261a', '7687184d-fb48-4499-abff-35bb443064c9', '8166ffb4-db66-4786-8306-0f5a514a200c'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:46:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b6330fb8-c306-418d-abb0-7c1d10ef5854 tempest-VolumesNegativeTest-981031237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b6330fb8-c306-418d-abb0-7c1d10ef5854 tempest-VolumesNegativeTest-981031237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:35 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b6330fb8-c306-418d-abb0-7c1d10ef5854 tempest-VolumesNegativeTest-981031237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:35 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b6330fb8-c306-418d-abb0-7c1d10ef5854 tempest-VolumesNegativeTest-981031237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b6330fb8-c306-418d-abb0-7c1d10ef5854 tempest-VolumesNegativeTest-981031237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b6330fb8-c306-418d-abb0-7c1d10ef5854 tempest-VolumesNegativeTest-981031237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:35 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:46:35 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:35 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b6330fb8-c306-418d-abb0-7c1d10ef5854 tempest-VolumesNegativeTest-981031237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.331s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:35 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-b6330fb8-c306-418d-abb0-7c1d10ef5854 tempest-VolumesNegativeTest-981031237 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:46:35 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b6330fb8-c306-418d-abb0-7c1d10ef5854 tempest-VolumesNegativeTest-981031237 None] Deleted volume successfully. Jul 24 09:46:35 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b6330fb8-c306-418d-abb0-7c1d10ef5854 tempest-VolumesNegativeTest-981031237 None] Lock "cinder-13680f7d-9bdb-4386-b7a4-f1243b71fee4-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:35 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:46:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Flow 'volume_create_manager' (a16848d6-a6a4-49c2-b947-b6017306de4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86771c13-9fc4-412e-ba17-d615e477e2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86771c13-9fc4-412e-ba17-d615e477e2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-738678408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b3c1a1-a242-4ccb-bde9-2c20770ac2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69714bec50e24f6482411081a222f346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:36Z,use_quota=True,user_id='72a6c15b8dae4e9894052671b1deb3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082053bf-7836-45fb-b15c-4b22d7f3571e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082053bf-7836-45fb-b15c-4b22d7f3571e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca0e901-b76b-4b23-bb4f-c064495c662d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:35 devstack cinder-volume[88488]: DEBUG cinder.image.glance [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Creating Keystone auth plugin from conf {{(pid=88488) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 09:46:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca0e901-b76b-4b23-bb4f-c064495c662d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '72b3c1a1-a242-4ccb-bde9-2c20770ac2d3', 'volume_name': 'volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3', 'volume_size': 1, 'image_id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3181d69d4e349c08df0ab05faa1a57c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'created_at': datetime.datetime(2026, 7, 24, 7, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90802a50-d78c-437a-8123-d683430fef67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90802a50-d78c-437a-8123-d683430fef67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e03642-2873-40d1-a7b7-eb71c7c9136a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:36 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Volume 72b3c1a1-a242-4ccb-bde9-2c20770ac2d3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3', 'volume_size': 1, 'image_id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3181d69d4e349c08df0ab05faa1a57c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'created_at': datetime.datetime(2026, 7, 24, 7, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 24 09:46:36 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Trying to clone 72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 from image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc at location (None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}]). {{(pid=88488) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 09:46:36 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_1fouy2qwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 09:46:36 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Image download 20.69 MB at 20.69 MB/s Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca56b45a-f260-4dd5-8ead-51e28bb50aa9]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_1fouy2qwdevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Flow 'volume_create_manager' (2928c843-8200-4fb0-8073-5b83da1d8007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2166fd4-c9dc-46c4-96c2-ed67dccdb991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2166fd4-c9dc-46c4-96c2-ed67dccdb991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-139726109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23589336-ca31-4d01-b6eb-75f23cf13d50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e67bea931641a28c277ddf81821efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:37Z,use_quota=True,user_id='303ae9ffda4344f7bf742e7aebd71006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:37 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_1fouy2qwdevstack@QuobyteHD Jul 24 09:46:37 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5cacb40-75e6-42f6-8bd4-dd37e536e3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5cacb40-75e6-42f6-8bd4-dd37e536e3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5433447-cf25-4abc-90a7-f1d32162ca0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5433447-cf25-4abc-90a7-f1d32162ca0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23589336-ca31-4d01-b6eb-75f23cf13d50', 'volume_name': 'volume-23589336-ca31-4d01-b6eb-75f23cf13d50', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9042038-ecf1-4ac4-9c23-58f486c229af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9042038-ecf1-4ac4-9c23-58f486c229af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a054b19-089f-4b49-ab72-3c37e59fbd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:37 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Volume 23589336-ca31-4d01-b6eb-75f23cf13d50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23589336-ca31-4d01-b6eb-75f23cf13d50', 'volume_size': 1} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-139726109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23589336-ca31-4d01-b6eb-75f23cf13d50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e67bea931641a28c277ddf81821efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:37Z,use_quota=True,user_id='303ae9ffda4344f7bf742e7aebd71006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Creating volume 23589336-ca31-4d01-b6eb-75f23cf13d50 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:46:37 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:37 devstack sudo[100076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50 1073741824 Jul 24 09:46:37 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:37 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_1fouy2qwdevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Temporary image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc is fetched for user 72a6c15b8dae4e9894052671b1deb3e6. {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee03342-2b49-42ea-af56-cd3a7fa652ac]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_1fouy2qwdevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:37 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_1fouy2qwdevstack@QuobyteHD Jul 24 09:46:37 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:37 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50 1073741824" returned: 0 in 0.696s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:38 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_1fouy2qwdevstack@QuobyteHD" returned: 0 in 0.475s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:38 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50 Jul 24 09:46:38 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:38 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-89c13f0a-a95e-4d99-999c-d9c80d11915f req-87282540-ed88-436d-9d22-00ab019af770 tempest-TestMinimumBasicScenario-942645551 None] Terminate volume connection completed successfully. Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-89c13f0a-a95e-4d99-999c-d9c80d11915f req-87282540-ed88-436d-9d22-00ab019af770 tempest-TestMinimumBasicScenario-942645551 None] Deleting attachment a488406b-177a-4c9f-a1ee-d7f746b774fb. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:46:38 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50" returned: 0 in 0.354s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.332s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-738678408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b3c1a1-a242-4ccb-bde9-2c20770ac2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69714bec50e24f6482411081a222f346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:36Z,use_quota=True,user_id='72a6c15b8dae4e9894052671b1deb3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Creating volume 72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:46:38 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a054b19-089f-4b49-ab72-3c37e59fbd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23589336-ca31-4d01-b6eb-75f23cf13d50', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:38 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 1073741824 Jul 24 09:46:38 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d036abcf-4acc-4a46-8627-970e9820629e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:38 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Volume volume-23589336-ca31-4d01-b6eb-75f23cf13d50 (23589336-ca31-4d01-b6eb-75f23cf13d50): created successfully Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d036abcf-4acc-4a46-8627-970e9820629e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Flow 'volume_create_manager' (2928c843-8200-4fb0-8073-5b83da1d8007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:38 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-0850ce96-5eab-481c-8726-26a17f8b9d46 tempest-SnapshotMetadataTestJSON-1944360531 None] Created volume successfully. Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-aa4e6baf-9e85-4fe2-87bc-e37653b12508 tempest-TestMinimumBasicScenario-942645551 None] Acquiring lock "cinder-f19a8415-ed66-4f66-9c37-64b137209875-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-aa4e6baf-9e85-4fe2-87bc-e37653b12508 tempest-TestMinimumBasicScenario-942645551 None] Lock "cinder-f19a8415-ed66-4f66-9c37-64b137209875-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-aa4e6baf-9e85-4fe2-87bc-e37653b12508 tempest-TestMinimumBasicScenario-942645551 None] Acquiring lock "cinder-quobyte-f19a8415-ed66-4f66-9c37-64b137209875" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:38 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 1073741824" returned: 0 in 0.562s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-aa4e6baf-9e85-4fe2-87bc-e37653b12508 tempest-TestMinimumBasicScenario-942645551 None] Lock "cinder-quobyte-f19a8415-ed66-4f66-9c37-64b137209875" acquired by "delete_volume" :: waited 0.036s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d5e558-dc54-46c2-b564-6033333c5817]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aa4e6baf-9e85-4fe2-87bc-e37653b12508 tempest-TestMinimumBasicScenario-942645551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f19a8415-ed66-4f66-9c37-64b137209875 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:39 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 Jul 24 09:46:39 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Flow 'volume_create_manager' (cee63300-b0ed-422b-ad52-9e62d5ee6fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3928caa8-5122-4935-90fc-cae0dfc63440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3928caa8-5122-4935-90fc-cae0dfc63440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-210919887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60f50db-026e-4c1a-b911-579ebc362b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811a1d61b84546debce96b444f8dcb65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:39Z,use_quota=True,user_id='01e83d61667a42f0ae2b48498d77a3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae69a7af-44ae-4b8d-b68f-f0822ee0a1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae69a7af-44ae-4b8d-b68f-f0822ee0a1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:39 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f19a8415-ed66-4f66-9c37-64b137209875 Jul 24 09:46:39 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1b33dd-5531-4a74-b81c-6bc564f08c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1b33dd-5531-4a74-b81c-6bc564f08c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd60f50db-026e-4c1a-b911-579ebc362b8c', 'volume_name': 'volume-d60f50db-026e-4c1a-b911-579ebc362b8c', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13e40a4-e526-48df-9018-a896cf68d9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13e40a4-e526-48df-9018-a896cf68d9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975932a9-a0d8-4af5-8da0-9c2c66435904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:39 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Volume d60f50db-026e-4c1a-b911-579ebc362b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d60f50db-026e-4c1a-b911-579ebc362b8c', 'volume_size': 1} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:39 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3" returned: 0 in 0.418s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.120s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-210919887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60f50db-026e-4c1a-b911-579ebc362b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811a1d61b84546debce96b444f8dcb65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:39Z,use_quota=True,user_id='01e83d61667a42f0ae2b48498d77a3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Creating volume d60f50db-026e-4c1a-b911-579ebc362b8c {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:46:39 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d60f50db-026e-4c1a-b911-579ebc362b8c 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:39 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d60f50db-026e-4c1a-b911-579ebc362b8c 1073741824 Jul 24 09:46:39 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Attempting download of ce0135c3-cdf3-4327-98f4-fcc81dc66bbc ((None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}])) to volume 72b3c1a1-a242-4ccb-bde9-2c20770ac2d3. {{(pid=88488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9549c9fb-939a-480b-886d-36f711d211ff tempest-SnapshotMetadataTestJSON-1944360531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9eedba-0b40-4963-942e-07755f2e252d]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_iz7x22ra {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:39 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aa4e6baf-9e85-4fe2-87bc-e37653b12508 tempest-TestMinimumBasicScenario-942645551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f19a8415-ed66-4f66-9c37-64b137209875" returned: 0 in 0.577s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aa4e6baf-9e85-4fe2-87bc-e37653b12508 tempest-TestMinimumBasicScenario-942645551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f19a8415-ed66-4f66-9c37-64b137209875 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:39 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f19a8415-ed66-4f66-9c37-64b137209875 Jul 24 09:46:39 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:39 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_iz7x22ra Jul 24 09:46:39 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Flow 'volume_create_manager' (f6dbab1f-8304-49d4-b191-776ebe6351bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52dbb79-701c-483e-938b-4f35eab5ecb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52dbb79-701c-483e-938b-4f35eab5ecb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-457411868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c094c27-610a-47ad-b011-7968c89e8c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811a1d61b84546debce96b444f8dcb65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:40Z,use_quota=True,user_id='01e83d61667a42f0ae2b48498d77a3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f6d3c3-542d-4716-8daf-078b242d5feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f6d3c3-542d-4716-8daf-078b242d5feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad90c609-782f-4ebf-913b-6ca0aa479d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad90c609-782f-4ebf-913b-6ca0aa479d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c094c27-610a-47ad-b011-7968c89e8c43', 'volume_name': 'volume-8c094c27-610a-47ad-b011-7968c89e8c43', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3380be86-56ac-498a-8336-28b9e77cfbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3380be86-56ac-498a-8336-28b9e77cfbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee572a38-3c38-4f2d-85e8-e2952d0c30d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:39 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Volume 8c094c27-610a-47ad-b011-7968c89e8c43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c094c27-610a-47ad-b011-7968c89e8c43', 'volume_size': 1} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:39 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aa4e6baf-9e85-4fe2-87bc-e37653b12508 tempest-TestMinimumBasicScenario-942645551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f19a8415-ed66-4f66-9c37-64b137209875" returned: 0 in 0.304s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:39 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-aa4e6baf-9e85-4fe2-87bc-e37653b12508 tempest-TestMinimumBasicScenario-942645551 None] Lock "cinder-quobyte-f19a8415-ed66-4f66-9c37-64b137209875" released by "delete_volume" :: held 0.967s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-aa4e6baf-9e85-4fe2-87bc-e37653b12508 tempest-TestMinimumBasicScenario-942645551 None] Created reservations ['6bb1f8d7-511e-494d-871d-f657ffab055b', 'b408764b-16a7-4ec3-9ef5-33e14503c3e0', 'be4e88b7-04a4-445f-88d0-b516ad2e3a14', 'efb7a697-7c50-4740-acdf-d51956f01240'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-aa4e6baf-9e85-4fe2-87bc-e37653b12508 tempest-TestMinimumBasicScenario-942645551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-aa4e6baf-9e85-4fe2-87bc-e37653b12508 tempest-TestMinimumBasicScenario-942645551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-aa4e6baf-9e85-4fe2-87bc-e37653b12508 tempest-TestMinimumBasicScenario-942645551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:40 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-aa4e6baf-9e85-4fe2-87bc-e37653b12508 tempest-TestMinimumBasicScenario-942645551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-aa4e6baf-9e85-4fe2-87bc-e37653b12508 tempest-TestMinimumBasicScenario-942645551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aa4e6baf-9e85-4fe2-87bc-e37653b12508 tempest-TestMinimumBasicScenario-942645551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:40 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_iz7x22ra" returned: 0 in 0.600s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d60f50db-026e-4c1a-b911-579ebc362b8c 1073741824" returned: 0 in 0.736s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_iz7x22ra {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:40 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:46:40 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Flow 'volume_create_manager' (42c09ce0-a59f-4bb8-81ea-bfbb14aea595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c46147-665f-420d-bf19-fcb919728e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d60f50db-026e-4c1a-b911-579ebc362b8c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c46147-665f-420d-bf19-fcb919728e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1134463136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64957351-2e3e-4e20-a672-2367ef9c4df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811a1d61b84546debce96b444f8dcb65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:40Z,use_quota=True,user_id='01e83d61667a42f0ae2b48498d77a3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b575e48-ef04-495f-a987-99c7d8c3bdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b575e48-ef04-495f-a987-99c7d8c3bdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:40 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_iz7x22ra Jul 24 09:46:40 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d60f50db-026e-4c1a-b911-579ebc362b8c Jul 24 09:46:40 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8eec4b3-e05b-4633-9d0e-2d2b25dcd194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:40 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8eec4b3-e05b-4633-9d0e-2d2b25dcd194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64957351-2e3e-4e20-a672-2367ef9c4df2', 'volume_name': 'volume-64957351-2e3e-4e20-a672-2367ef9c4df2', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e99d9a-d65c-4ad3-876c-f1c95e17be1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e99d9a-d65c-4ad3-876c-f1c95e17be1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07566d38-e614-4d38-b90e-9bf9a31d0505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:40 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Volume 64957351-2e3e-4e20-a672-2367ef9c4df2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64957351-2e3e-4e20-a672-2367ef9c4df2', 'volume_size': 1} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:40 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aa4e6baf-9e85-4fe2-87bc-e37653b12508 tempest-TestMinimumBasicScenario-942645551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.354s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-aa4e6baf-9e85-4fe2-87bc-e37653b12508 tempest-TestMinimumBasicScenario-942645551 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:46:40 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-aa4e6baf-9e85-4fe2-87bc-e37653b12508 tempest-TestMinimumBasicScenario-942645551 None] Deleted volume successfully. Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-aa4e6baf-9e85-4fe2-87bc-e37653b12508 tempest-TestMinimumBasicScenario-942645551 None] Lock "cinder-f19a8415-ed66-4f66-9c37-64b137209875-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:40 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d60f50db-026e-4c1a-b911-579ebc362b8c" returned: 0 in 0.336s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9549c9fb-939a-480b-886d-36f711d211ff tempest-SnapshotMetadataTestJSON-1944360531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.101s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975932a9-a0d8-4af5-8da0-9c2c66435904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d60f50db-026e-4c1a-b911-579ebc362b8c', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bfba55c-d719-49bc-a8c0-7a260d002091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:40 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-9549c9fb-939a-480b-886d-36f711d211ff tempest-SnapshotMetadataTestJSON-1944360531 None] Creating offline snapshot d724f50b-c611-400c-ad55-f50c1d5d5efe of volume 23589336-ca31-4d01-b6eb-75f23cf13d50 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_iz7x22ra" returned: 1 in 0.512s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_iz7x22ra' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:46:40 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Volume volume-d60f50db-026e-4c1a-b911-579ebc362b8c (d60f50db-026e-4c1a-b911-579ebc362b8c): created successfully Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bfba55c-d719-49bc-a8c0-7a260d002091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Flow 'volume_create_manager' (cee63300-b0ed-422b-ad52-9e62d5ee6fa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b97e795-2d0c-4c3d-a892-95f906453a1e]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc867f6-652c-46da-8b51-c6359b136404]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_1fouy2qwdevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9549c9fb-939a-480b-886d-36f711d211ff tempest-SnapshotMetadataTestJSON-1944360531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:40 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-7151b5bf-ad3f-4f43-a735-ae3992d206b4 tempest-CreateVolumesFromImageTest-2070808574 None] Created volume successfully. Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Flow 'volume_create_manager' (2ccfebfd-24f5-49c0-be89-4ae207b53b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98892844-a427-4760-8606-d1ba1d9a0c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98892844-a427-4760-8606-d1ba1d9a0c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1254080477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54964300-a441-4fe0-976c-f0f76109a720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811a1d61b84546debce96b444f8dcb65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:41Z,use_quota=True,user_id='01e83d61667a42f0ae2b48498d77a3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f610d49-365c-477d-b89b-aba3904fa11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:40 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_1fouy2qwdevstack@QuobyteHD Jul 24 09:46:40 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f610d49-365c-477d-b89b-aba3904fa11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b7ae65-2240-44f2-9489-bba1044c5037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b7ae65-2240-44f2-9489-bba1044c5037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54964300-a441-4fe0-976c-f0f76109a720', 'volume_name': 'volume-54964300-a441-4fe0-976c-f0f76109a720', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e845c0b-0a21-4920-b0e4-a2eaf3ee90f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e845c0b-0a21-4920-b0e4-a2eaf3ee90f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c6dfe8-26e9-4314-b99c-ade38b037ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:40 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Volume 54964300-a441-4fe0-976c-f0f76109a720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54964300-a441-4fe0-976c-f0f76109a720', 'volume_size': 1} Jul 24 09:46:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:40 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50 Jul 24 09:46:40 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:41 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:46:41 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Flow 'volume_create_manager' (454b2aad-4f3d-4c8c-a6f5-4e63a8363e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1521597-d209-47c4-9fe6-68c7e8ba2192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_1fouy2qwdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:41 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] ce0135c3-cdf3-4327-98f4-fcc81dc66bbc was qcow2, converting to qcow2 {{(pid=88488) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 09:46:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_1fouy2qwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:41 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1521597-d209-47c4-9fe6-68c7e8ba2192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1656548432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df97d967-064b-43ed-a533-029b0bf2b915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811a1d61b84546debce96b444f8dcb65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:41Z,use_quota=True,user_id='01e83d61667a42f0ae2b48498d77a3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b6c1f0-36d0-451d-b6a1-fb71cffe8274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:41 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_1fouy2qwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 Jul 24 09:46:41 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b6c1f0-36d0-451d-b6a1-fb71cffe8274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1bd2ca9-f4b6-478d-ad9f-aa73543681d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1bd2ca9-f4b6-478d-ad9f-aa73543681d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df97d967-064b-43ed-a533-029b0bf2b915', 'volume_name': 'volume-df97d967-064b-43ed-a533-029b0bf2b915', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d60ff44f-140f-42ef-943f-9124dff04786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d60ff44f-140f-42ef-943f-9124dff04786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cecd0b5-542b-4eed-a221-3bdb3e4ac691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:41 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Volume df97d967-064b-43ed-a533-029b0bf2b915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df97d967-064b-43ed-a533-029b0bf2b915', 'volume_size': 1} Jul 24 09:46:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9549c9fb-939a-480b-886d-36f711d211ff tempest-SnapshotMetadataTestJSON-1944360531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50" returned: 0 in 0.526s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9549c9fb-939a-480b-886d-36f711d211ff tempest-SnapshotMetadataTestJSON-1944360531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.d724f50b-c611-400c-ad55-f50c1d5d5efe 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:41 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.d724f50b-c611-400c-ad55-f50c1d5d5efe 1G Jul 24 09:46:41 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:41 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9549c9fb-939a-480b-886d-36f711d211ff tempest-SnapshotMetadataTestJSON-1944360531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.d724f50b-c611-400c-ad55-f50c1d5d5efe 1G" returned: 0 in 0.489s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9549c9fb-939a-480b-886d-36f711d211ff tempest-SnapshotMetadataTestJSON-1944360531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23589336-ca31-4d01-b6eb-75f23cf13d50 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.d724f50b-c611-400c-ad55-f50c1d5d5efe {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:41 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23589336-ca31-4d01-b6eb-75f23cf13d50 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.d724f50b-c611-400c-ad55-f50c1d5d5efe Jul 24 09:46:41 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:42 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9549c9fb-939a-480b-886d-36f711d211ff tempest-SnapshotMetadataTestJSON-1944360531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23589336-ca31-4d01-b6eb-75f23cf13d50 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.d724f50b-c611-400c-ad55-f50c1d5d5efe" returned: 0 in 0.448s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:42 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-9549c9fb-939a-480b-886d-36f711d211ff tempest-SnapshotMetadataTestJSON-1944360531 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.d724f50b-c611-400c-ad55-f50c1d5d5efe is being set with open permissions: ugo+rw Jul 24 09:46:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9549c9fb-939a-480b-886d-36f711d211ff tempest-SnapshotMetadataTestJSON-1944360531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.d724f50b-c611-400c-ad55-f50c1d5d5efe {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:42 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.d724f50b-c611-400c-ad55-f50c1d5d5efe Jul 24 09:46:42 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:42 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9549c9fb-939a-480b-886d-36f711d211ff tempest-SnapshotMetadataTestJSON-1944360531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.d724f50b-c611-400c-ad55-f50c1d5d5efe" returned: 0 in 0.388s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9549c9fb-939a-480b-886d-36f711d211ff tempest-SnapshotMetadataTestJSON-1944360531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:42 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.info Jul 24 09:46:42 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:43 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9549c9fb-939a-480b-886d-36f711d211ff tempest-SnapshotMetadataTestJSON-1944360531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.info" returned: 0 in 0.416s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:43 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-9549c9fb-939a-480b-886d-36f711d211ff tempest-SnapshotMetadataTestJSON-1944360531 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.info is being set with open permissions: ugo+rw Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9549c9fb-939a-480b-886d-36f711d211ff tempest-SnapshotMetadataTestJSON-1944360531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:43 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.info Jul 24 09:46:43 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:43 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9549c9fb-939a-480b-886d-36f711d211ff tempest-SnapshotMetadataTestJSON-1944360531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.info" returned: 0 in 0.308s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9549c9fb-939a-480b-886d-36f711d211ff tempest-SnapshotMetadataTestJSON-1944360531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.748s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.493s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-457411868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c094c27-610a-47ad-b011-7968c89e8c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811a1d61b84546debce96b444f8dcb65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:40Z,use_quota=True,user_id='01e83d61667a42f0ae2b48498d77a3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Creating volume 8c094c27-610a-47ad-b011-7968c89e8c43 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:46:43 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8c094c27-610a-47ad-b011-7968c89e8c43 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:43 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8c094c27-610a-47ad-b011-7968c89e8c43 1073741824 Jul 24 09:46:43 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:43 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-9549c9fb-939a-480b-886d-36f711d211ff tempest-SnapshotMetadataTestJSON-1944360531 None] Create snapshot completed successfully Jul 24 09:46:43 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_1fouy2qwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3" returned: 0 in 2.307s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_1fouy2qwdevstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:46:43 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Converted 112.00 MB image at 48.53 MB/s Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:43 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 1G Jul 24 09:46:43 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:43 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8c094c27-610a-47ad-b011-7968c89e8c43 1073741824" returned: 0 in 0.470s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:43 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 1G" returned: 0 in 0.384s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Downloaded image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc ((None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}])) to volume 72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 successfully. {{(pid=88488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Temporary image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc for user 72a6c15b8dae4e9894052671b1deb3e6 is deleted. {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Marking volume 72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 as bootable. {{(pid=88488) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Copying metadata from image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc to 72b3c1a1-a242-4ccb-bde9-2c20770ac2d3. {{(pid=88488) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Creating volume glance metadata for volume 72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 backed by image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88488) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 09:46:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8c094c27-610a-47ad-b011-7968c89e8c43 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:44 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8c094c27-610a-47ad-b011-7968c89e8c43 Jul 24 09:46:44 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e03642-2873-40d1-a7b7-eb71c7c9136a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3', 'volume_size': 1, 'image_id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3181d69d4e349c08df0ab05faa1a57c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'created_at': datetime.datetime(2026, 7, 24, 7, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf02828d-1d7c-4b46-8611-794f36b47159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:44 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Volume volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 (72b3c1a1-a242-4ccb-bde9-2c20770ac2d3): created successfully Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf02828d-1d7c-4b46-8611-794f36b47159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Flow 'volume_create_manager' (a16848d6-a6a4-49c2-b947-b6017306de4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:44 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-1794f71f-914e-42d2-9752-a04325b82b40 tempest-VolumesExtendTest-1491633024 None] Created volume successfully. Jul 24 09:46:44 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8c094c27-610a-47ad-b011-7968c89e8c43" returned: 0 in 0.375s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.947s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1134463136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64957351-2e3e-4e20-a672-2367ef9c4df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811a1d61b84546debce96b444f8dcb65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:40Z,use_quota=True,user_id='01e83d61667a42f0ae2b48498d77a3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Creating volume 64957351-2e3e-4e20-a672-2367ef9c4df2 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:46:44 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-64957351-2e3e-4e20-a672-2367ef9c4df2 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee572a38-3c38-4f2d-85e8-e2952d0c30d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c094c27-610a-47ad-b011-7968c89e8c43', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173951b1-4854-4459-b600-ae599c02a99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:44 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-64957351-2e3e-4e20-a672-2367ef9c4df2 1073741824 Jul 24 09:46:44 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:44 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Volume volume-8c094c27-610a-47ad-b011-7968c89e8c43 (8c094c27-610a-47ad-b011-7968c89e8c43): created successfully Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173951b1-4854-4459-b600-ae599c02a99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Flow 'volume_create_manager' (f6dbab1f-8304-49d4-b191-776ebe6351bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:44 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-841c0f07-0f17-4a8d-bb80-dbca01357361 tempest-CreateVolumesFromImageTest-2070808574 None] Created volume successfully. Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] Acquiring lock "cinder-d724f50b-c611-400c-ad55-f50c1d5d5efe-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] Lock "cinder-d724f50b-c611-400c-ad55-f50c1d5d5efe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] Acquiring lock "cinder-quobyte-23589336-ca31-4d01-b6eb-75f23cf13d50" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] Lock "cinder-quobyte-23589336-ca31-4d01-b6eb-75f23cf13d50" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] Acquiring lock "cinder-quobyte-d724f50b-c611-400c-ad55-f50c1d5d5efe" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] Lock "cinder-quobyte-d724f50b-c611-400c-ad55-f50c1d5d5efe" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] Deleting offline snapshot d724f50b-c611-400c-ad55-f50c1d5d5efe of volume 23589336-ca31-4d01-b6eb-75f23cf13d50 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] snapshot_file for this snap is: volume-23589336-ca31-4d01-b6eb-75f23cf13d50.d724f50b-c611-400c-ad55-f50c1d5d5efe {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73e75b5-2966-499b-ab2e-3353a4ae35ad]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.d724f50b-c611-400c-ad55-f50c1d5d5efe {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-91a8e08c-917f-403f-b92b-504f3add9d6a tempest-VolumesExtendTest-1491633024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:44 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.d724f50b-c611-400c-ad55-f50c1d5d5efe Jul 24 09:46:44 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:44 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-64957351-2e3e-4e20-a672-2367ef9c4df2 1073741824" returned: 0 in 0.544s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-64957351-2e3e-4e20-a672-2367ef9c4df2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:45 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-64957351-2e3e-4e20-a672-2367ef9c4df2 Jul 24 09:46:45 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:45 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.d724f50b-c611-400c-ad55-f50c1d5d5efe" returned: 0 in 0.433s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23589336-ca31-4d01-b6eb-75f23cf13d50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[695377a6-6f4b-4878-a76d-64a98b787a3a]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:45 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50 Jul 24 09:46:45 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:45 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-64957351-2e3e-4e20-a672-2367ef9c4df2" returned: 0 in 0.305s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.358s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1254080477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54964300-a441-4fe0-976c-f0f76109a720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811a1d61b84546debce96b444f8dcb65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:41Z,use_quota=True,user_id='01e83d61667a42f0ae2b48498d77a3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Creating volume 54964300-a441-4fe0-976c-f0f76109a720 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:46:45 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54964300-a441-4fe0-976c-f0f76109a720 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07566d38-e614-4d38-b90e-9bf9a31d0505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64957351-2e3e-4e20-a672-2367ef9c4df2', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:45 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54964300-a441-4fe0-976c-f0f76109a720 1073741824 Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aadbb484-3047-4998-88ff-2e2b1e9cd203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:45 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:45 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Volume volume-64957351-2e3e-4e20-a672-2367ef9c4df2 (64957351-2e3e-4e20-a672-2367ef9c4df2): created successfully Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aadbb484-3047-4998-88ff-2e2b1e9cd203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Flow 'volume_create_manager' (42c09ce0-a59f-4bb8-81ea-bfbb14aea595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:45 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-a522b13f-2ddc-46f8-bac1-d25352ac2b2b tempest-CreateVolumesFromImageTest-2070808574 None] Created volume successfully. Jul 24 09:46:45 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50" returned: 0 in 0.427s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.d724f50b-c611-400c-ad55-f50c1d5d5efe {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:45 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.d724f50b-c611-400c-ad55-f50c1d5d5efe Jul 24 09:46:45 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:45 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54964300-a441-4fe0-976c-f0f76109a720 1073741824" returned: 0 in 0.491s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54964300-a441-4fe0-976c-f0f76109a720 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:45 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54964300-a441-4fe0-976c-f0f76109a720 Jul 24 09:46:45 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:45 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.d724f50b-c611-400c-ad55-f50c1d5d5efe" returned: 0 in 0.440s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.d724f50b-c611-400c-ad55-f50c1d5d5efe {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:45 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.d724f50b-c611-400c-ad55-f50c1d5d5efe Jul 24 09:46:45 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:46 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54964300-a441-4fe0-976c-f0f76109a720" returned: 0 in 0.296s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.820s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1656548432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df97d967-064b-43ed-a533-029b0bf2b915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811a1d61b84546debce96b444f8dcb65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:41Z,use_quota=True,user_id='01e83d61667a42f0ae2b48498d77a3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Creating volume df97d967-064b-43ed-a533-029b0bf2b915 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:46:46 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df97d967-064b-43ed-a533-029b0bf2b915 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c6dfe8-26e9-4314-b99c-ade38b037ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54964300-a441-4fe0-976c-f0f76109a720', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c98aca8-e814-47a1-92cf-5be5e70db0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:46 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df97d967-064b-43ed-a533-029b0bf2b915 1073741824 Jul 24 09:46:46 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:46 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Volume volume-54964300-a441-4fe0-976c-f0f76109a720 (54964300-a441-4fe0-976c-f0f76109a720): created successfully Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c98aca8-e814-47a1-92cf-5be5e70db0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Flow 'volume_create_manager' (2ccfebfd-24f5-49c0-be89-4ae207b53b90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:46 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-cd276248-b502-42f0-a230-e915e2f6de88 tempest-CreateVolumesFromImageTest-2070808574 None] Created volume successfully. Jul 24 09:46:46 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50.d724f50b-c611-400c-ad55-f50c1d5d5efe" returned: 0 in 0.283s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] Lock "cinder-quobyte-d724f50b-c611-400c-ad55-f50c1d5d5efe" released by "_delete_snapshot" :: held 1.696s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] Lock "cinder-quobyte-23589336-ca31-4d01-b6eb-75f23cf13d50" released by "delete_snapshot" :: held 1.722s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] Created reservations ['44ebfe60-2dc4-4bf0-96af-54cf39896562', '1addf87c-b2af-4e03-8d29-2b6744bfe829', 'a40f274d-56f8-4667-8c38-2ab75f05e24d', '62638575-049a-4b0c-a3dd-b6546b9e09a3'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:46:46 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] Delete snapshot completed successfully. Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9e1489b9-b504-4190-ade5-abbbe592e4b8 tempest-SnapshotMetadataTestJSON-1944360531 None] Lock "cinder-d724f50b-c611-400c-ad55-f50c1d5d5efe-delete_snapshot" released by "delete_snapshot" :: held 1.912s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:46 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df97d967-064b-43ed-a533-029b0bf2b915 1073741824" returned: 0 in 0.495s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df97d967-064b-43ed-a533-029b0bf2b915 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:46 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df97d967-064b-43ed-a533-029b0bf2b915 Jul 24 09:46:46 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8b6949a1-e09e-4eae-bf8d-bfd32a49160b tempest-SnapshotMetadataTestJSON-1944360531 None] Acquiring lock "cinder-23589336-ca31-4d01-b6eb-75f23cf13d50-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8b6949a1-e09e-4eae-bf8d-bfd32a49160b tempest-SnapshotMetadataTestJSON-1944360531 None] Lock "cinder-23589336-ca31-4d01-b6eb-75f23cf13d50-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8b6949a1-e09e-4eae-bf8d-bfd32a49160b tempest-SnapshotMetadataTestJSON-1944360531 None] Acquiring lock "cinder-quobyte-23589336-ca31-4d01-b6eb-75f23cf13d50" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8b6949a1-e09e-4eae-bf8d-bfd32a49160b tempest-SnapshotMetadataTestJSON-1944360531 None] Lock "cinder-quobyte-23589336-ca31-4d01-b6eb-75f23cf13d50" acquired by "delete_volume" :: waited 0.033s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf82b16-78a3-4055-a23f-457884733ef3]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8b6949a1-e09e-4eae-bf8d-bfd32a49160b tempest-SnapshotMetadataTestJSON-1944360531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:47 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df97d967-064b-43ed-a533-029b0bf2b915" returned: 0 in 0.371s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-91a8e08c-917f-403f-b92b-504f3add9d6a tempest-VolumesExtendTest-1491633024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.266s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cecd0b5-542b-4eed-a221-3bdb3e4ac691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df97d967-064b-43ed-a533-029b0bf2b915', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66cab35-9ba0-4249-a5b9-d7a54eddc148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17a44bb-546f-4f2f-9571-3554b72b1d07]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-91a8e08c-917f-403f-b92b-504f3add9d6a tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:47 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Volume volume-df97d967-064b-43ed-a533-029b0bf2b915 (df97d967-064b-43ed-a533-029b0bf2b915): created successfully Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66cab35-9ba0-4249-a5b9-d7a54eddc148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:47 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50 Jul 24 09:46:47 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Flow 'volume_create_manager' (454b2aad-4f3d-4c8c-a6f5-4e63a8363e9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:47 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-a66cad4c-f53f-46d3-8896-a90104f3f349 tempest-CreateVolumesFromImageTest-2070808574 None] Created volume successfully. Jul 24 09:46:47 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 Jul 24 09:46:47 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:47 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8b6949a1-e09e-4eae-bf8d-bfd32a49160b tempest-SnapshotMetadataTestJSON-1944360531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50" returned: 0 in 0.466s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8b6949a1-e09e-4eae-bf8d-bfd32a49160b tempest-SnapshotMetadataTestJSON-1944360531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:47 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50 Jul 24 09:46:47 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:47 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-91a8e08c-917f-403f-b92b-504f3add9d6a tempest-VolumesExtendTest-1491633024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3" returned: 0 in 0.480s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-91a8e08c-917f-403f-b92b-504f3add9d6a tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 2G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-91a8e08c-917f-403f-b92b-504f3add9d6a tempest-VolumesExtendTest-1491633024 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 2G" returned: 0 in 0.123s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-91a8e08c-917f-403f-b92b-504f3add9d6a tempest-VolumesExtendTest-1491633024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.643s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:47 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8b6949a1-e09e-4eae-bf8d-bfd32a49160b tempest-SnapshotMetadataTestJSON-1944360531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-23589336-ca31-4d01-b6eb-75f23cf13d50" returned: 0 in 0.268s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8b6949a1-e09e-4eae-bf8d-bfd32a49160b tempest-SnapshotMetadataTestJSON-1944360531 None] Lock "cinder-quobyte-23589336-ca31-4d01-b6eb-75f23cf13d50" released by "delete_volume" :: held 0.815s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:47 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-91a8e08c-917f-403f-b92b-504f3add9d6a tempest-VolumesExtendTest-1491633024 None] Extend volume completed successfully. Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-8b6949a1-e09e-4eae-bf8d-bfd32a49160b tempest-SnapshotMetadataTestJSON-1944360531 None] Created reservations ['202ac800-f142-4552-a594-0d7b6191c86e', 'd215678c-8f4e-42ca-bc9d-40268ec2148c', '51f23b29-f63d-480e-847e-fb919e71fe9c', 'c0b63788-5b4f-4f3a-bec2-6e03e16b4979'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8b6949a1-e09e-4eae-bf8d-bfd32a49160b tempest-SnapshotMetadataTestJSON-1944360531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8b6949a1-e09e-4eae-bf8d-bfd32a49160b tempest-SnapshotMetadataTestJSON-1944360531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8b6949a1-e09e-4eae-bf8d-bfd32a49160b tempest-SnapshotMetadataTestJSON-1944360531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8b6949a1-e09e-4eae-bf8d-bfd32a49160b tempest-SnapshotMetadataTestJSON-1944360531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8b6949a1-e09e-4eae-bf8d-bfd32a49160b tempest-SnapshotMetadataTestJSON-1944360531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8b6949a1-e09e-4eae-bf8d-bfd32a49160b tempest-SnapshotMetadataTestJSON-1944360531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:47 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:46:47 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b2ad6330-0f7c-4371-9cfa-d6feb7b3ea0d tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "cinder-df97d967-064b-43ed-a533-029b0bf2b915-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b2ad6330-0f7c-4371-9cfa-d6feb7b3ea0d tempest-CreateVolumesFromImageTest-2070808574 None] Lock "cinder-df97d967-064b-43ed-a533-029b0bf2b915-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b2ad6330-0f7c-4371-9cfa-d6feb7b3ea0d tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "cinder-quobyte-df97d967-064b-43ed-a533-029b0bf2b915" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b2ad6330-0f7c-4371-9cfa-d6feb7b3ea0d tempest-CreateVolumesFromImageTest-2070808574 None] Lock "cinder-quobyte-df97d967-064b-43ed-a533-029b0bf2b915" acquired by "delete_volume" :: waited 0.031s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:48 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa29635-1e81-4e37-aa47-304aff9c2d01]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b2ad6330-0f7c-4371-9cfa-d6feb7b3ea0d tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df97d967-064b-43ed-a533-029b0bf2b915 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:48 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df97d967-064b-43ed-a533-029b0bf2b915 Jul 24 09:46:48 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:48 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1ef3e054-25f8-41ac-a1e7-6bcda756a569 tempest-VolumesExtendTest-1491633024 None] Acquiring lock "cinder-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8b6949a1-e09e-4eae-bf8d-bfd32a49160b tempest-SnapshotMetadataTestJSON-1944360531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.500s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:48 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-8b6949a1-e09e-4eae-bf8d-bfd32a49160b tempest-SnapshotMetadataTestJSON-1944360531 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:46:48 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-8b6949a1-e09e-4eae-bf8d-bfd32a49160b tempest-SnapshotMetadataTestJSON-1944360531 None] Deleted volume successfully. Jul 24 09:46:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1ef3e054-25f8-41ac-a1e7-6bcda756a569 tempest-VolumesExtendTest-1491633024 None] Lock "cinder-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8b6949a1-e09e-4eae-bf8d-bfd32a49160b tempest-SnapshotMetadataTestJSON-1944360531 None] Lock "cinder-23589336-ca31-4d01-b6eb-75f23cf13d50-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1ef3e054-25f8-41ac-a1e7-6bcda756a569 tempest-VolumesExtendTest-1491633024 None] Acquiring lock "cinder-quobyte-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1ef3e054-25f8-41ac-a1e7-6bcda756a569 tempest-VolumesExtendTest-1491633024 None] Lock "cinder-quobyte-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3" acquired by "delete_volume" :: waited 0.024s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:48 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d801f765-efa2-4491-a851-47b5d3d4b194]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1ef3e054-25f8-41ac-a1e7-6bcda756a569 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:48 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b2ad6330-0f7c-4371-9cfa-d6feb7b3ea0d tempest-CreateVolumesFromImageTest-2070808574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df97d967-064b-43ed-a533-029b0bf2b915" returned: 0 in 0.544s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b2ad6330-0f7c-4371-9cfa-d6feb7b3ea0d tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df97d967-064b-43ed-a533-029b0bf2b915 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:48 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 Jul 24 09:46:48 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:48 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df97d967-064b-43ed-a533-029b0bf2b915 Jul 24 09:46:48 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:48 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b2ad6330-0f7c-4371-9cfa-d6feb7b3ea0d tempest-CreateVolumesFromImageTest-2070808574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df97d967-064b-43ed-a533-029b0bf2b915" returned: 0 in 0.292s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:48 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b2ad6330-0f7c-4371-9cfa-d6feb7b3ea0d tempest-CreateVolumesFromImageTest-2070808574 None] Lock "cinder-quobyte-df97d967-064b-43ed-a533-029b0bf2b915" released by "delete_volume" :: held 0.908s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1ef3e054-25f8-41ac-a1e7-6bcda756a569 tempest-VolumesExtendTest-1491633024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3" returned: 0 in 0.408s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1ef3e054-25f8-41ac-a1e7-6bcda756a569 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:49 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3 Jul 24 09:46:49 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-b2ad6330-0f7c-4371-9cfa-d6feb7b3ea0d tempest-CreateVolumesFromImageTest-2070808574 None] Created reservations ['ca246b3f-7ba9-43df-9009-34a2dc3afe0a', 'ff0c4f84-c00b-4629-9e8c-c5c05ea21a3f', '28403d00-073c-4b86-be1d-da42b01440f7', '57632b2d-962f-4c6c-8844-1cd6cb41ec5a'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b2ad6330-0f7c-4371-9cfa-d6feb7b3ea0d tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b2ad6330-0f7c-4371-9cfa-d6feb7b3ea0d tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b2ad6330-0f7c-4371-9cfa-d6feb7b3ea0d tempest-CreateVolumesFromImageTest-2070808574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b2ad6330-0f7c-4371-9cfa-d6feb7b3ea0d tempest-CreateVolumesFromImageTest-2070808574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b2ad6330-0f7c-4371-9cfa-d6feb7b3ea0d tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b2ad6330-0f7c-4371-9cfa-d6feb7b3ea0d tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:49 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:46:49 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:49 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1ef3e054-25f8-41ac-a1e7-6bcda756a569 tempest-VolumesExtendTest-1491633024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3" returned: 0 in 0.396s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1ef3e054-25f8-41ac-a1e7-6bcda756a569 tempest-VolumesExtendTest-1491633024 None] Lock "cinder-quobyte-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3" released by "delete_volume" :: held 0.860s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-1ef3e054-25f8-41ac-a1e7-6bcda756a569 tempest-VolumesExtendTest-1491633024 None] Created reservations ['7f7aa140-7c60-456d-8ed5-eb40a34de795', 'e270aaba-5ba3-4364-9c62-f7291612ab19', '4f2b147c-1b48-4ee2-9103-01c452c82dca', 'ca4e488d-4d77-4f52-8c46-8fe33f98d595'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1ef3e054-25f8-41ac-a1e7-6bcda756a569 tempest-VolumesExtendTest-1491633024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1ef3e054-25f8-41ac-a1e7-6bcda756a569 tempest-VolumesExtendTest-1491633024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1ef3e054-25f8-41ac-a1e7-6bcda756a569 tempest-VolumesExtendTest-1491633024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1ef3e054-25f8-41ac-a1e7-6bcda756a569 tempest-VolumesExtendTest-1491633024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1ef3e054-25f8-41ac-a1e7-6bcda756a569 tempest-VolumesExtendTest-1491633024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1ef3e054-25f8-41ac-a1e7-6bcda756a569 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:49 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b2ad6330-0f7c-4371-9cfa-d6feb7b3ea0d tempest-CreateVolumesFromImageTest-2070808574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.397s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-b2ad6330-0f7c-4371-9cfa-d6feb7b3ea0d tempest-CreateVolumesFromImageTest-2070808574 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:46:49 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b2ad6330-0f7c-4371-9cfa-d6feb7b3ea0d tempest-CreateVolumesFromImageTest-2070808574 None] Deleted volume successfully. Jul 24 09:46:49 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:46:49 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b2ad6330-0f7c-4371-9cfa-d6feb7b3ea0d tempest-CreateVolumesFromImageTest-2070808574 None] Lock "cinder-df97d967-064b-43ed-a533-029b0bf2b915-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:49 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1ef3e054-25f8-41ac-a1e7-6bcda756a569 tempest-VolumesExtendTest-1491633024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.283s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-1ef3e054-25f8-41ac-a1e7-6bcda756a569 tempest-VolumesExtendTest-1491633024 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:46:49 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-1ef3e054-25f8-41ac-a1e7-6bcda756a569 tempest-VolumesExtendTest-1491633024 None] Deleted volume successfully. Jul 24 09:46:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1ef3e054-25f8-41ac-a1e7-6bcda756a569 tempest-VolumesExtendTest-1491633024 None] Lock "cinder-72b3c1a1-a242-4ccb-bde9-2c20770ac2d3-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:50 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e229b16a-6eb0-4158-b4d9-3c43b6223c19 tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "cinder-54964300-a441-4fe0-976c-f0f76109a720-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:50 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e229b16a-6eb0-4158-b4d9-3c43b6223c19 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "cinder-54964300-a441-4fe0-976c-f0f76109a720-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:50 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e229b16a-6eb0-4158-b4d9-3c43b6223c19 tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "cinder-quobyte-54964300-a441-4fe0-976c-f0f76109a720" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:50 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e229b16a-6eb0-4158-b4d9-3c43b6223c19 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "cinder-quobyte-54964300-a441-4fe0-976c-f0f76109a720" acquired by "delete_volume" :: waited 0.039s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:50 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[523dd090-5a67-43e0-9910-3dc5212de89d]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e229b16a-6eb0-4158-b4d9-3c43b6223c19 tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54964300-a441-4fe0-976c-f0f76109a720 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:50 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54964300-a441-4fe0-976c-f0f76109a720 Jul 24 09:46:50 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:50 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e229b16a-6eb0-4158-b4d9-3c43b6223c19 tempest-CreateVolumesFromImageTest-2070808574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54964300-a441-4fe0-976c-f0f76109a720" returned: 0 in 0.412s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e229b16a-6eb0-4158-b4d9-3c43b6223c19 tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54964300-a441-4fe0-976c-f0f76109a720 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:50 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54964300-a441-4fe0-976c-f0f76109a720 Jul 24 09:46:50 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:51 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e229b16a-6eb0-4158-b4d9-3c43b6223c19 tempest-CreateVolumesFromImageTest-2070808574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54964300-a441-4fe0-976c-f0f76109a720" returned: 0 in 0.339s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e229b16a-6eb0-4158-b4d9-3c43b6223c19 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "cinder-quobyte-54964300-a441-4fe0-976c-f0f76109a720" released by "delete_volume" :: held 0.808s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-e229b16a-6eb0-4158-b4d9-3c43b6223c19 tempest-CreateVolumesFromImageTest-2070808574 None] Created reservations ['d0280f6e-4ac1-4b43-8ffd-3d44118095fb', 'c8afbfa4-4361-4446-bf07-4e796652462f', '76b6d3c3-b2b9-41ac-aca5-55721230cfed', '3a462032-ba64-4c2a-ba45-2a2a605ec1da'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Flow 'volume_create_manager' (c8d1d5cf-40c6-4be8-b16b-ef2a179e7647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccbd242-2613-4e35-b7f9-9757b6750a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccbd242-2613-4e35-b7f9-9757b6750a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1458027151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4c3d32-a84f-40f3-bd21-fa69209ee6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69714bec50e24f6482411081a222f346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:51Z,use_quota=True,user_id='72a6c15b8dae4e9894052671b1deb3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5bb93a-8bb1-4962-8776-9107d07a8597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5bb93a-8bb1-4962-8776-9107d07a8597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65408fb-611e-437a-97dc-c90818ad53bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65408fb-611e-437a-97dc-c90818ad53bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d4c3d32-a84f-40f3-bd21-fa69209ee6a6', 'volume_name': 'volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7565ac-bce2-44e7-8f54-e6a0ea99a096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7565ac-bce2-44e7-8f54-e6a0ea99a096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c136cef4-0d6b-418f-a31a-c701d7443bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:51 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Volume 1d4c3d32-a84f-40f3-bd21-fa69209ee6a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6', 'volume_size': 1} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1458027151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4c3d32-a84f-40f3-bd21-fa69209ee6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69714bec50e24f6482411081a222f346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:51Z,use_quota=True,user_id='72a6c15b8dae4e9894052671b1deb3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Creating volume 1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:46:51 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:51 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 1073741824 Jul 24 09:46:51 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e229b16a-6eb0-4158-b4d9-3c43b6223c19 tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e229b16a-6eb0-4158-b4d9-3c43b6223c19 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e229b16a-6eb0-4158-b4d9-3c43b6223c19 tempest-CreateVolumesFromImageTest-2070808574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e229b16a-6eb0-4158-b4d9-3c43b6223c19 tempest-CreateVolumesFromImageTest-2070808574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e229b16a-6eb0-4158-b4d9-3c43b6223c19 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e229b16a-6eb0-4158-b4d9-3c43b6223c19 tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:51 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:46:51 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:51 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e229b16a-6eb0-4158-b4d9-3c43b6223c19 tempest-CreateVolumesFromImageTest-2070808574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.359s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-e229b16a-6eb0-4158-b4d9-3c43b6223c19 tempest-CreateVolumesFromImageTest-2070808574 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:46:51 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e229b16a-6eb0-4158-b4d9-3c43b6223c19 tempest-CreateVolumesFromImageTest-2070808574 None] Deleted volume successfully. Jul 24 09:46:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e229b16a-6eb0-4158-b4d9-3c43b6223c19 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "cinder-54964300-a441-4fe0-976c-f0f76109a720-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:52 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 1073741824" returned: 0 in 0.649s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:52 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 Jul 24 09:46:52 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:52 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6" returned: 0 in 0.278s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:46:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c136cef4-0d6b-418f-a31a-c701d7443bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37d48a9-1cf5-4dd5-bfda-753b28926d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:52 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Volume volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 (1d4c3d32-a84f-40f3-bd21-fa69209ee6a6): created successfully Jul 24 09:46:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37d48a9-1cf5-4dd5-bfda-753b28926d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Flow 'volume_create_manager' (c8d1d5cf-40c6-4be8-b16b-ef2a179e7647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:52 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-67845a1c-0709-426e-bebd-a77e5905c365 tempest-VolumesExtendTest-1491633024 None] Created volume successfully. Jul 24 09:46:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-318d5537-4f87-472e-be57-007f351af06c tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "cinder-64957351-2e3e-4e20-a672-2367ef9c4df2-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-318d5537-4f87-472e-be57-007f351af06c tempest-CreateVolumesFromImageTest-2070808574 None] Lock "cinder-64957351-2e3e-4e20-a672-2367ef9c4df2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-318d5537-4f87-472e-be57-007f351af06c tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "cinder-quobyte-64957351-2e3e-4e20-a672-2367ef9c4df2" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-318d5537-4f87-472e-be57-007f351af06c tempest-CreateVolumesFromImageTest-2070808574 None] Lock "cinder-quobyte-64957351-2e3e-4e20-a672-2367ef9c4df2" acquired by "delete_volume" :: waited 0.040s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:52 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bade1d9-3b8c-40ba-9c56-5b4ab9a78dd2]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-318d5537-4f87-472e-be57-007f351af06c tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-64957351-2e3e-4e20-a672-2367ef9c4df2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:52 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-64957351-2e3e-4e20-a672-2367ef9c4df2 Jul 24 09:46:52 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:53 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-318d5537-4f87-472e-be57-007f351af06c tempest-CreateVolumesFromImageTest-2070808574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-64957351-2e3e-4e20-a672-2367ef9c4df2" returned: 0 in 0.432s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-318d5537-4f87-472e-be57-007f351af06c tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-64957351-2e3e-4e20-a672-2367ef9c4df2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:53 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-64957351-2e3e-4e20-a672-2367ef9c4df2 Jul 24 09:46:53 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:53 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-318d5537-4f87-472e-be57-007f351af06c tempest-CreateVolumesFromImageTest-2070808574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-64957351-2e3e-4e20-a672-2367ef9c4df2" returned: 0 in 0.302s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-318d5537-4f87-472e-be57-007f351af06c tempest-CreateVolumesFromImageTest-2070808574 None] Lock "cinder-quobyte-64957351-2e3e-4e20-a672-2367ef9c4df2" released by "delete_volume" :: held 0.783s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-318d5537-4f87-472e-be57-007f351af06c tempest-CreateVolumesFromImageTest-2070808574 None] Created reservations ['df8a38d9-0aae-4af5-b998-56264b184fc1', 'fa671728-4d2f-4e7e-a6c8-83636ae571b8', 'a21b83ba-09d5-494f-88b3-6052355dee94', 'a47e5af7-1926-4ef5-bf54-a65b5446e0ec'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-79c5aa82-9399-4c85-b0b0-2b913819b3f4 tempest-VolumesExtendTest-1491633024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-79c5aa82-9399-4c85-b0b0-2b913819b3f4 tempest-VolumesExtendTest-1491633024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-79c5aa82-9399-4c85-b0b0-2b913819b3f4 tempest-VolumesExtendTest-1491633024 None] Creating offline snapshot 0c450151-6c12-40f0-b6a4-da581cc0714b of volume 1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-318d5537-4f87-472e-be57-007f351af06c tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-318d5537-4f87-472e-be57-007f351af06c tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-318d5537-4f87-472e-be57-007f351af06c tempest-CreateVolumesFromImageTest-2070808574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-318d5537-4f87-472e-be57-007f351af06c tempest-CreateVolumesFromImageTest-2070808574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-318d5537-4f87-472e-be57-007f351af06c tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-318d5537-4f87-472e-be57-007f351af06c tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1ee625-895b-49a2-9dd3-86369c7f3a4a]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-79c5aa82-9399-4c85-b0b0-2b913819b3f4 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:53 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:46:53 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-311aaa1f-8b3b-4e6b-a192-e38fd9ba1ec0 tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "cinder-8c094c27-610a-47ad-b011-7968c89e8c43-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-311aaa1f-8b3b-4e6b-a192-e38fd9ba1ec0 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "cinder-8c094c27-610a-47ad-b011-7968c89e8c43-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:53 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 Jul 24 09:46:53 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-311aaa1f-8b3b-4e6b-a192-e38fd9ba1ec0 tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "cinder-quobyte-8c094c27-610a-47ad-b011-7968c89e8c43" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-311aaa1f-8b3b-4e6b-a192-e38fd9ba1ec0 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "cinder-quobyte-8c094c27-610a-47ad-b011-7968c89e8c43" acquired by "delete_volume" :: waited 0.029s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66d0cd1-52c8-4788-b400-c202b01f749e]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-311aaa1f-8b3b-4e6b-a192-e38fd9ba1ec0 tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8c094c27-610a-47ad-b011-7968c89e8c43 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:54 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8c094c27-610a-47ad-b011-7968c89e8c43 Jul 24 09:46:54 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:54 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-318d5537-4f87-472e-be57-007f351af06c tempest-CreateVolumesFromImageTest-2070808574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.553s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:54 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-318d5537-4f87-472e-be57-007f351af06c tempest-CreateVolumesFromImageTest-2070808574 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:46:54 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-318d5537-4f87-472e-be57-007f351af06c tempest-CreateVolumesFromImageTest-2070808574 None] Deleted volume successfully. Jul 24 09:46:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-318d5537-4f87-472e-be57-007f351af06c tempest-CreateVolumesFromImageTest-2070808574 None] Lock "cinder-64957351-2e3e-4e20-a672-2367ef9c4df2-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:54 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-79c5aa82-9399-4c85-b0b0-2b913819b3f4 tempest-VolumesExtendTest-1491633024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6" returned: 0 in 0.666s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-79c5aa82-9399-4c85-b0b0-2b913819b3f4 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:54 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b 1G Jul 24 09:46:54 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:54 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-311aaa1f-8b3b-4e6b-a192-e38fd9ba1ec0 tempest-CreateVolumesFromImageTest-2070808574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8c094c27-610a-47ad-b011-7968c89e8c43" returned: 0 in 0.510s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-311aaa1f-8b3b-4e6b-a192-e38fd9ba1ec0 tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8c094c27-610a-47ad-b011-7968c89e8c43 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:54 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8c094c27-610a-47ad-b011-7968c89e8c43 Jul 24 09:46:54 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:54 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-311aaa1f-8b3b-4e6b-a192-e38fd9ba1ec0 tempest-CreateVolumesFromImageTest-2070808574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8c094c27-610a-47ad-b011-7968c89e8c43" returned: 0 in 0.283s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-311aaa1f-8b3b-4e6b-a192-e38fd9ba1ec0 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "cinder-quobyte-8c094c27-610a-47ad-b011-7968c89e8c43" released by "delete_volume" :: held 0.856s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:54 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-311aaa1f-8b3b-4e6b-a192-e38fd9ba1ec0 tempest-CreateVolumesFromImageTest-2070808574 None] Created reservations ['39732b05-7ae9-4609-8e63-eeb4f52a2044', '26f4d247-c42a-4414-b66f-cbb0343359e8', '7694e703-a622-4147-bec9-067c3a5949a5', '41abb5f3-96aa-4a9b-af05-b607f2d6d93a'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:46:54 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-79c5aa82-9399-4c85-b0b0-2b913819b3f4 tempest-VolumesExtendTest-1491633024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b 1G" returned: 0 in 0.578s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-79c5aa82-9399-4c85-b0b0-2b913819b3f4 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:54 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b Jul 24 09:46:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-311aaa1f-8b3b-4e6b-a192-e38fd9ba1ec0 tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-311aaa1f-8b3b-4e6b-a192-e38fd9ba1ec0 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:54 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-311aaa1f-8b3b-4e6b-a192-e38fd9ba1ec0 tempest-CreateVolumesFromImageTest-2070808574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-311aaa1f-8b3b-4e6b-a192-e38fd9ba1ec0 tempest-CreateVolumesFromImageTest-2070808574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-311aaa1f-8b3b-4e6b-a192-e38fd9ba1ec0 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-311aaa1f-8b3b-4e6b-a192-e38fd9ba1ec0 tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:55 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:46:55 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:55 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b46c728a-9109-40ef-b346-f8943d8dee90 tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "cinder-d60f50db-026e-4c1a-b911-579ebc362b8c-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:55 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b46c728a-9109-40ef-b346-f8943d8dee90 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "cinder-d60f50db-026e-4c1a-b911-579ebc362b8c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:55 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b46c728a-9109-40ef-b346-f8943d8dee90 tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "cinder-quobyte-d60f50db-026e-4c1a-b911-579ebc362b8c" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:55 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b46c728a-9109-40ef-b346-f8943d8dee90 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "cinder-quobyte-d60f50db-026e-4c1a-b911-579ebc362b8c" acquired by "delete_volume" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:55 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d787515-cced-4969-b552-eeac65731700]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b46c728a-9109-40ef-b346-f8943d8dee90 tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d60f50db-026e-4c1a-b911-579ebc362b8c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:55 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-79c5aa82-9399-4c85-b0b0-2b913819b3f4 tempest-VolumesExtendTest-1491633024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b" returned: 0 in 0.452s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:55 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-79c5aa82-9399-4c85-b0b0-2b913819b3f4 tempest-VolumesExtendTest-1491633024 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b is being set with open permissions: ugo+rw Jul 24 09:46:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-79c5aa82-9399-4c85-b0b0-2b913819b3f4 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:55 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b Jul 24 09:46:55 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:55 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-311aaa1f-8b3b-4e6b-a192-e38fd9ba1ec0 tempest-CreateVolumesFromImageTest-2070808574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.458s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:55 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-311aaa1f-8b3b-4e6b-a192-e38fd9ba1ec0 tempest-CreateVolumesFromImageTest-2070808574 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:46:55 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-311aaa1f-8b3b-4e6b-a192-e38fd9ba1ec0 tempest-CreateVolumesFromImageTest-2070808574 None] Deleted volume successfully. Jul 24 09:46:55 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d60f50db-026e-4c1a-b911-579ebc362b8c Jul 24 09:46:55 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:55 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-311aaa1f-8b3b-4e6b-a192-e38fd9ba1ec0 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "cinder-8c094c27-610a-47ad-b011-7968c89e8c43-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:55 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-79c5aa82-9399-4c85-b0b0-2b913819b3f4 tempest-VolumesExtendTest-1491633024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b" returned: 0 in 0.357s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:55 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-79c5aa82-9399-4c85-b0b0-2b913819b3f4 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b46c728a-9109-40ef-b346-f8943d8dee90 tempest-CreateVolumesFromImageTest-2070808574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d60f50db-026e-4c1a-b911-579ebc362b8c" returned: 0 in 0.510s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b46c728a-9109-40ef-b346-f8943d8dee90 tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d60f50db-026e-4c1a-b911-579ebc362b8c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:55 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.info Jul 24 09:46:55 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:55 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d60f50db-026e-4c1a-b911-579ebc362b8c Jul 24 09:46:55 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:56 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b46c728a-9109-40ef-b346-f8943d8dee90 tempest-CreateVolumesFromImageTest-2070808574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d60f50db-026e-4c1a-b911-579ebc362b8c" returned: 0 in 0.288s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:56 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b46c728a-9109-40ef-b346-f8943d8dee90 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "cinder-quobyte-d60f50db-026e-4c1a-b911-579ebc362b8c" released by "delete_volume" :: held 0.857s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-79c5aa82-9399-4c85-b0b0-2b913819b3f4 tempest-VolumesExtendTest-1491633024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.info" returned: 0 in 0.337s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:56 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-79c5aa82-9399-4c85-b0b0-2b913819b3f4 tempest-VolumesExtendTest-1491633024 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.info is being set with open permissions: ugo+rw Jul 24 09:46:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-79c5aa82-9399-4c85-b0b0-2b913819b3f4 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:56 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.info Jul 24 09:46:56 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:56 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-b46c728a-9109-40ef-b346-f8943d8dee90 tempest-CreateVolumesFromImageTest-2070808574 None] Created reservations ['37e4455e-943c-42bc-9d66-7d44b76ede00', '5cbb70e4-dc1a-4c68-80a4-2902d45b0d37', 'e5ea1870-d55b-467b-a128-5724d3315dd2', '8fd9c3d0-c662-48eb-87e2-535186170e8a'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:46:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b46c728a-9109-40ef-b346-f8943d8dee90 tempest-CreateVolumesFromImageTest-2070808574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b46c728a-9109-40ef-b346-f8943d8dee90 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b46c728a-9109-40ef-b346-f8943d8dee90 tempest-CreateVolumesFromImageTest-2070808574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b46c728a-9109-40ef-b346-f8943d8dee90 tempest-CreateVolumesFromImageTest-2070808574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b46c728a-9109-40ef-b346-f8943d8dee90 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b46c728a-9109-40ef-b346-f8943d8dee90 tempest-CreateVolumesFromImageTest-2070808574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:56 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:46:56 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:56 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-79c5aa82-9399-4c85-b0b0-2b913819b3f4 tempest-VolumesExtendTest-1491633024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.info" returned: 0 in 0.299s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-79c5aa82-9399-4c85-b0b0-2b913819b3f4 tempest-VolumesExtendTest-1491633024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.835s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:56 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-79c5aa82-9399-4c85-b0b0-2b913819b3f4 tempest-VolumesExtendTest-1491633024 None] Create snapshot completed successfully Jul 24 09:46:56 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b46c728a-9109-40ef-b346-f8943d8dee90 tempest-CreateVolumesFromImageTest-2070808574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.297s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:56 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-b46c728a-9109-40ef-b346-f8943d8dee90 tempest-CreateVolumesFromImageTest-2070808574 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:46:56 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b46c728a-9109-40ef-b346-f8943d8dee90 tempest-CreateVolumesFromImageTest-2070808574 None] Deleted volume successfully. Jul 24 09:46:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b46c728a-9109-40ef-b346-f8943d8dee90 tempest-CreateVolumesFromImageTest-2070808574 None] Lock "cinder-d60f50db-026e-4c1a-b911-579ebc362b8c-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:46:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d355c3b4-57b8-4a03-9f61-0ab69b788714 tempest-VolumesExtendTest-1491633024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d355c3b4-57b8-4a03-9f61-0ab69b788714 tempest-VolumesExtendTest-1491633024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:57 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab00234a-7125-4b8f-930f-cbc212817fda]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d355c3b4-57b8-4a03-9f61-0ab69b788714 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:57 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 Jul 24 09:46:57 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:57 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d355c3b4-57b8-4a03-9f61-0ab69b788714 tempest-VolumesExtendTest-1491633024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6" returned: 0 in 0.508s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d355c3b4-57b8-4a03-9f61-0ab69b788714 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b 2G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d355c3b4-57b8-4a03-9f61-0ab69b788714 tempest-VolumesExtendTest-1491633024 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b 2G" returned: 0 in 0.216s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d355c3b4-57b8-4a03-9f61-0ab69b788714 tempest-VolumesExtendTest-1491633024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.778s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:57 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d355c3b4-57b8-4a03-9f61-0ab69b788714 tempest-VolumesExtendTest-1491633024 None] Extend volume completed successfully. Jul 24 09:46:57 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:46:57 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Flow 'volume_create_manager' (905c1d06-20f3-4c4b-81fb-8d49ec5669fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a77cdc-5af8-42ad-be01-17b17dc377d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a77cdc-5af8-42ad-be01-17b17dc377d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-275333844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf80857-0f95-4a45-8628-5f200403c322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab15a9fb6cb1441ea8e3c93d2c74cae0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:58Z,use_quota=True,user_id='92c49c704ecd481db752ea49b21c3766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162db5a1-6ed7-42a5-a773-695481aa2dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162db5a1-6ed7-42a5-a773-695481aa2dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b802a6ba-f187-402d-95a5-38447e020db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b802a6ba-f187-402d-95a5-38447e020db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bf80857-0f95-4a45-8628-5f200403c322', 'volume_name': 'volume-3bf80857-0f95-4a45-8628-5f200403c322', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be739d67-e15a-42df-8dc4-f1618a063af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be739d67-e15a-42df-8dc4-f1618a063af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baec8772-c28b-4f85-b48c-c051002efea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:58 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Volume 3bf80857-0f95-4a45-8628-5f200403c322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bf80857-0f95-4a45-8628-5f200403c322', 'volume_size': 1} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-275333844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf80857-0f95-4a45-8628-5f200403c322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab15a9fb6cb1441ea8e3c93d2c74cae0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:46:58Z,use_quota=True,user_id='92c49c704ecd481db752ea49b21c3766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Creating volume 3bf80857-0f95-4a45-8628-5f200403c322 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:46:58 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3bf80857-0f95-4a45-8628-5f200403c322 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:58 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3bf80857-0f95-4a45-8628-5f200403c322 1073741824 Jul 24 09:46:58 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] Acquiring lock "cinder-0c450151-6c12-40f0-b6a4-da581cc0714b-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] Lock "cinder-0c450151-6c12-40f0-b6a4-da581cc0714b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] Acquiring lock "cinder-quobyte-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] Lock "cinder-quobyte-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] Acquiring lock "cinder-quobyte-0c450151-6c12-40f0-b6a4-da581cc0714b" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] Lock "cinder-quobyte-0c450151-6c12-40f0-b6a4-da581cc0714b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] Deleting offline snapshot 0c450151-6c12-40f0-b6a4-da581cc0714b of volume 1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] snapshot_file for this snap is: volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a9a8b9-40ac-4b65-b3d2-177cb10d8744]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:58 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b Jul 24 09:46:58 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:58 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3bf80857-0f95-4a45-8628-5f200403c322 1073741824" returned: 0 in 0.671s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3bf80857-0f95-4a45-8628-5f200403c322 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:58 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3bf80857-0f95-4a45-8628-5f200403c322 Jul 24 09:46:58 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:59 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b" returned: 0 in 0.494s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:46:59 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06d6bb8-834d-4531-a99d-c10efdab1038]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:46:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:59 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3bf80857-0f95-4a45-8628-5f200403c322" returned: 0 in 0.355s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:46:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:46:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baec8772-c28b-4f85-b48c-c051002efea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf80857-0f95-4a45-8628-5f200403c322', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849a8e0f-098e-4434-8066-0853fff474cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:46:59 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Volume volume-3bf80857-0f95-4a45-8628-5f200403c322 (3bf80857-0f95-4a45-8628-5f200403c322): created successfully Jul 24 09:46:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849a8e0f-098e-4434-8066-0853fff474cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:46:59 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 Jul 24 09:46:59 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:46:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Flow 'volume_create_manager' (905c1d06-20f3-4c4b-81fb-8d49ec5669fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:46:59 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-9b181a72-38ce-4414-a55e-085918dab224 tempest-VolumesTransfersV355Test-184965878 None] Created volume successfully. Jul 24 09:46:59 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Jul 24 09:46:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6" returned: 0 in 0.458s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:46:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:46:59 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b Jul 24 09:46:59 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:00 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b" returned: 0 in 0.455s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:00 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b Jul 24 09:47:00 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Flow 'volume_create_manager' (62efa584-a456-4454-9e49-df97f51cfbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4a9889-1b76-4445-9fe0-e11da64d6d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4a9889-1b76-4445-9fe0-e11da64d6d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-967119340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d64cd29-a1b0-4c9a-91f7-9e2140d1454c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3344caa34d405eb6db56eba0b7e138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:00Z,use_quota=True,user_id='a6b5b8db5d684287b9883b851747ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7528ed8d-e89a-47a2-80cd-8f5aee7992e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7528ed8d-e89a-47a2-80cd-8f5aee7992e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153e433e-d2de-41bd-b3f4-42224d74649a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153e433e-d2de-41bd-b3f4-42224d74649a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d64cd29-a1b0-4c9a-91f7-9e2140d1454c', 'volume_name': 'volume-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bbe9ee7-c426-434b-8f81-92d6cc03dc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bbe9ee7-c426-434b-8f81-92d6cc03dc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5041954-8a42-4e2c-999b-190cfe22e09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:00 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Volume 0d64cd29-a1b0-4c9a-91f7-9e2140d1454c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c', 'volume_size': 1} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-967119340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d64cd29-a1b0-4c9a-91f7-9e2140d1454c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3344caa34d405eb6db56eba0b7e138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:00Z,use_quota=True,user_id='a6b5b8db5d684287b9883b851747ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Creating volume 0d64cd29-a1b0-4c9a-91f7-9e2140d1454c {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:47:00 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:00 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c 1073741824 Jul 24 09:47:00 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:00 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6.0c450151-6c12-40f0-b6a4-da581cc0714b" returned: 0 in 0.396s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] Lock "cinder-quobyte-0c450151-6c12-40f0-b6a4-da581cc0714b" released by "_delete_snapshot" :: held 1.923s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] Lock "cinder-quobyte-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6" released by "delete_snapshot" :: held 1.953s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] Created reservations ['a5b0e03a-472a-4473-9308-c96cf9556127', 'da7c7b33-7055-44f9-90c6-d50a17e9998f', 'd9e75ee4-9780-40ce-845a-fd512e2d1bdf', '7cfcfb3b-6566-4888-aa7d-0dce364b1767'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:47:00 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] Delete snapshot completed successfully. Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e636c03d-e02d-4b0f-8c18-071a0ec6ab8a tempest-VolumesExtendTest-1491633024 None] Lock "cinder-0c450151-6c12-40f0-b6a4-da581cc0714b-delete_snapshot" released by "delete_snapshot" :: held 2.168s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:00 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c 1073741824" returned: 0 in 0.600s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:00 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-5bfbc424-2be4-40f6-88d3-90d5099d548e tempest-VolumesTransfersV355Test-25241846 None] Transfer volume completed successfully. Jul 24 09:47:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:00 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c Jul 24 09:47:00 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:01 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c" returned: 0 in 0.264s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5041954-8a42-4e2c-999b-190cfe22e09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83bd3d79-98ba-4b0f-8971-1ce9182368d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:01 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Volume volume-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c (0d64cd29-a1b0-4c9a-91f7-9e2140d1454c): created successfully Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83bd3d79-98ba-4b0f-8971-1ce9182368d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Flow 'volume_create_manager' (62efa584-a456-4454-9e49-df97f51cfbab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:01 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-4ad1d22a-4e2e-400a-b124-249a8a51de60 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Created volume successfully. Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c7c94bf6-5857-4c00-86e8-f75d5ea2365c tempest-VolumesTransfersV355Test-188663003 None] Acquiring lock "cinder-3bf80857-0f95-4a45-8628-5f200403c322-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c7c94bf6-5857-4c00-86e8-f75d5ea2365c tempest-VolumesTransfersV355Test-188663003 None] Lock "cinder-3bf80857-0f95-4a45-8628-5f200403c322-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c7c94bf6-5857-4c00-86e8-f75d5ea2365c tempest-VolumesTransfersV355Test-188663003 None] Acquiring lock "cinder-quobyte-3bf80857-0f95-4a45-8628-5f200403c322" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c7c94bf6-5857-4c00-86e8-f75d5ea2365c tempest-VolumesTransfersV355Test-188663003 None] Lock "cinder-quobyte-3bf80857-0f95-4a45-8628-5f200403c322" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4278324c-ed0b-4167-ba0d-b353976c7637]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c7c94bf6-5857-4c00-86e8-f75d5ea2365c tempest-VolumesTransfersV355Test-188663003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3bf80857-0f95-4a45-8628-5f200403c322 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:01 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3bf80857-0f95-4a45-8628-5f200403c322 Jul 24 09:47:01 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f2871dad-5294-4cc9-979f-aab11134c9f8 tempest-VolumesExtendTest-1491633024 None] Acquiring lock "cinder-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f2871dad-5294-4cc9-979f-aab11134c9f8 tempest-VolumesExtendTest-1491633024 None] Lock "cinder-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f2871dad-5294-4cc9-979f-aab11134c9f8 tempest-VolumesExtendTest-1491633024 None] Acquiring lock "cinder-quobyte-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f2871dad-5294-4cc9-979f-aab11134c9f8 tempest-VolumesExtendTest-1491633024 None] Lock "cinder-quobyte-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[812521a7-7f1f-4775-9104-2b07d77f4d67]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f2871dad-5294-4cc9-979f-aab11134c9f8 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:01 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c7c94bf6-5857-4c00-86e8-f75d5ea2365c tempest-VolumesTransfersV355Test-188663003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3bf80857-0f95-4a45-8628-5f200403c322" returned: 0 in 0.391s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c7c94bf6-5857-4c00-86e8-f75d5ea2365c tempest-VolumesTransfersV355Test-188663003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3bf80857-0f95-4a45-8628-5f200403c322 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:01 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3bf80857-0f95-4a45-8628-5f200403c322 Jul 24 09:47:01 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:02 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 Jul 24 09:47:02 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:02 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c7c94bf6-5857-4c00-86e8-f75d5ea2365c tempest-VolumesTransfersV355Test-188663003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3bf80857-0f95-4a45-8628-5f200403c322" returned: 0 in 0.409s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:02 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c7c94bf6-5857-4c00-86e8-f75d5ea2365c tempest-VolumesTransfersV355Test-188663003 None] Lock "cinder-quobyte-3bf80857-0f95-4a45-8628-5f200403c322" released by "delete_volume" :: held 0.861s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:02 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-c7c94bf6-5857-4c00-86e8-f75d5ea2365c tempest-VolumesTransfersV355Test-188663003 None] Created reservations ['f90271c5-8ecf-40d9-9058-c4fa103ec096', '5819ec60-120d-4d56-ae6f-e620689c82c4', '36a0541d-09e6-4d0d-aab5-28b5cd88d140', '5302dce9-b2dd-4b9e-a784-08babe7bc1c8'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:47:02 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f2871dad-5294-4cc9-979f-aab11134c9f8 tempest-VolumesExtendTest-1491633024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6" returned: 0 in 0.594s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f2871dad-5294-4cc9-979f-aab11134c9f8 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:02 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6 Jul 24 09:47:02 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c7c94bf6-5857-4c00-86e8-f75d5ea2365c tempest-VolumesTransfersV355Test-188663003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c7c94bf6-5857-4c00-86e8-f75d5ea2365c tempest-VolumesTransfersV355Test-188663003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c7c94bf6-5857-4c00-86e8-f75d5ea2365c tempest-VolumesTransfersV355Test-188663003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c7c94bf6-5857-4c00-86e8-f75d5ea2365c tempest-VolumesTransfersV355Test-188663003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c7c94bf6-5857-4c00-86e8-f75d5ea2365c tempest-VolumesTransfersV355Test-188663003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c7c94bf6-5857-4c00-86e8-f75d5ea2365c tempest-VolumesTransfersV355Test-188663003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:02 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:47:02 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:02 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f2871dad-5294-4cc9-979f-aab11134c9f8 tempest-VolumesExtendTest-1491633024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6" returned: 0 in 0.451s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f2871dad-5294-4cc9-979f-aab11134c9f8 tempest-VolumesExtendTest-1491633024 None] Lock "cinder-quobyte-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6" released by "delete_volume" :: held 1.116s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:03 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c7c94bf6-5857-4c00-86e8-f75d5ea2365c tempest-VolumesTransfersV355Test-188663003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.365s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-c7c94bf6-5857-4c00-86e8-f75d5ea2365c tempest-VolumesTransfersV355Test-188663003 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:47:03 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c7c94bf6-5857-4c00-86e8-f75d5ea2365c tempest-VolumesTransfersV355Test-188663003 None] Deleted volume successfully. Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c7c94bf6-5857-4c00-86e8-f75d5ea2365c tempest-VolumesTransfersV355Test-188663003 None] Lock "cinder-3bf80857-0f95-4a45-8628-5f200403c322-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-f2871dad-5294-4cc9-979f-aab11134c9f8 tempest-VolumesExtendTest-1491633024 None] Created reservations ['b99f0ccb-8fb8-4666-bd32-1febc383b616', '0a527ab7-a57e-4486-ba5a-f3628d516028', 'b110300d-bd01-489e-b2a3-6db47e9b8778', 'e1b1495d-9bbc-4ea1-b461-6f102e4de987'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Flow 'volume_create_manager' (3308b600-022d-41ba-845a-034abaa355f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c25b11-564e-4f5d-87cb-6ade89783a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c25b11-564e-4f5d-87cb-6ade89783a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-835450067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0d8f06-30ee-4340-a931-e6cbc0c6cf96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3344caa34d405eb6db56eba0b7e138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:03Z,use_quota=True,user_id='a6b5b8db5d684287b9883b851747ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869cd894-6997-4411-9463-2d72eff34553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869cd894-6997-4411-9463-2d72eff34553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ac55f7-b7c0-493c-b789-89578de0f62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ac55f7-b7c0-493c-b789-89578de0f62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc0d8f06-30ee-4340-a931-e6cbc0c6cf96', 'volume_name': 'volume-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9baf8a6a-b745-4fb5-a4fb-d52aa5763a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9baf8a6a-b745-4fb5-a4fb-d52aa5763a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a5ce65-8242-4437-91c0-b31fa0bf6e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:03 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Volume cc0d8f06-30ee-4340-a931-e6cbc0c6cf96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96', 'volume_size': 1} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-835450067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0d8f06-30ee-4340-a931-e6cbc0c6cf96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3344caa34d405eb6db56eba0b7e138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:03Z,use_quota=True,user_id='a6b5b8db5d684287b9883b851747ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Creating volume cc0d8f06-30ee-4340-a931-e6cbc0c6cf96 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:47:03 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:03 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96 1073741824 Jul 24 09:47:03 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f2871dad-5294-4cc9-979f-aab11134c9f8 tempest-VolumesExtendTest-1491633024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f2871dad-5294-4cc9-979f-aab11134c9f8 tempest-VolumesExtendTest-1491633024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f2871dad-5294-4cc9-979f-aab11134c9f8 tempest-VolumesExtendTest-1491633024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f2871dad-5294-4cc9-979f-aab11134c9f8 tempest-VolumesExtendTest-1491633024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f2871dad-5294-4cc9-979f-aab11134c9f8 tempest-VolumesExtendTest-1491633024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f2871dad-5294-4cc9-979f-aab11134c9f8 tempest-VolumesExtendTest-1491633024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:03 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:47:03 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Flow 'volume_create_manager' (b33db76f-9265-4c1f-8874-1b69d15457db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9882ab3-1401-43ca-8708-483973fb68dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9882ab3-1401-43ca-8708-483973fb68dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-609711806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66cd4a10-423f-405e-8d31-4a1ae56518cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3344caa34d405eb6db56eba0b7e138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:03Z,use_quota=True,user_id='a6b5b8db5d684287b9883b851747ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb46ce6d-0a3f-49c7-9127-0357283ed480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb46ce6d-0a3f-49c7-9127-0357283ed480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f03a156-d41e-40b4-9404-57d5986afd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f03a156-d41e-40b4-9404-57d5986afd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66cd4a10-423f-405e-8d31-4a1ae56518cd', 'volume_name': 'volume-66cd4a10-423f-405e-8d31-4a1ae56518cd', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a7823a-5a1e-4ac1-9509-d1d1b69b58a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a7823a-5a1e-4ac1-9509-d1d1b69b58a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7dcfa3-2954-4bbf-94fe-d67845ae10f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:03 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Volume 66cd4a10-423f-405e-8d31-4a1ae56518cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66cd4a10-423f-405e-8d31-4a1ae56518cd', 'volume_size': 1} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:03 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f2871dad-5294-4cc9-979f-aab11134c9f8 tempest-VolumesExtendTest-1491633024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.391s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-f2871dad-5294-4cc9-979f-aab11134c9f8 tempest-VolumesExtendTest-1491633024 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:47:03 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-f2871dad-5294-4cc9-979f-aab11134c9f8 tempest-VolumesExtendTest-1491633024 None] Deleted volume successfully. Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f2871dad-5294-4cc9-979f-aab11134c9f8 tempest-VolumesExtendTest-1491633024 None] Lock "cinder-1d4c3d32-a84f-40f3-bd21-fa69209ee6a6-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:03 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96 1073741824" returned: 0 in 0.655s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:04 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96 Jul 24 09:47:04 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Flow 'volume_create_manager' (57364cb2-b3d4-4cb9-90d0-a5bb20155bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1771eb04-28ee-42d6-b287-1dd961c0dad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1771eb04-28ee-42d6-b287-1dd961c0dad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-773667784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe5c252-6c20-46ba-bbc2-112ae31d8dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3344caa34d405eb6db56eba0b7e138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:04Z,use_quota=True,user_id='a6b5b8db5d684287b9883b851747ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ee9bab-fe5d-470a-899c-84274beda1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ee9bab-fe5d-470a-899c-84274beda1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7acd9dee-f1ad-4ada-a246-5514cf99b1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7acd9dee-f1ad-4ada-a246-5514cf99b1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fe5c252-6c20-46ba-bbc2-112ae31d8dbe', 'volume_name': 'volume-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1c00e2-d74e-4bfc-ae2a-952064d6c772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1c00e2-d74e-4bfc-ae2a-952064d6c772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d33ae86-507f-4992-b8fd-743554d2ec0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:04 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Volume 7fe5c252-6c20-46ba-bbc2-112ae31d8dbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe', 'volume_size': 1} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:04 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96" returned: 0 in 0.459s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.742s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-609711806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66cd4a10-423f-405e-8d31-4a1ae56518cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3344caa34d405eb6db56eba0b7e138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:03Z,use_quota=True,user_id='a6b5b8db5d684287b9883b851747ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Creating volume 66cd4a10-423f-405e-8d31-4a1ae56518cd {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:47:04 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-66cd4a10-423f-405e-8d31-4a1ae56518cd 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:04 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-66cd4a10-423f-405e-8d31-4a1ae56518cd 1073741824 Jul 24 09:47:04 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a5ce65-8242-4437-91c0-b31fa0bf6e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a070d57f-dc1e-4476-958d-f79c30e2f784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:04 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Volume volume-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96 (cc0d8f06-30ee-4340-a931-e6cbc0c6cf96): created successfully Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a070d57f-dc1e-4476-958d-f79c30e2f784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:04 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Flow 'volume_create_manager' (3308b600-022d-41ba-845a-034abaa355f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:04 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-206b9acc-6a34-4617-b122-69089d483f62 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Created volume successfully. Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Flow 'volume_create_manager' (bf0828cc-1ae9-44dd-9eeb-8b015ce0416e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c7d7ac4-7711-4946-9afc-182076de6932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:05 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-66cd4a10-423f-405e-8d31-4a1ae56518cd 1073741824" returned: 0 in 0.842s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c7d7ac4-7711-4946-9afc-182076de6932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1251506340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e17b53-1e4c-4f46-9e59-25b2ad358e7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3344caa34d405eb6db56eba0b7e138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:05Z,use_quota=True,user_id='a6b5b8db5d684287b9883b851747ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2af9b63-6787-4044-ad8d-c8776f3a8f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2af9b63-6787-4044-ad8d-c8776f3a8f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52e535f9-75c8-46a2-9fb5-8a0e876924c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52e535f9-75c8-46a2-9fb5-8a0e876924c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76e17b53-1e4c-4f46-9e59-25b2ad358e7b', 'volume_name': 'volume-76e17b53-1e4c-4f46-9e59-25b2ad358e7b', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49ce955-df4e-4a97-9f33-adb41564fe20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49ce955-df4e-4a97-9f33-adb41564fe20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5112143d-c6ec-4e9b-a02f-037ebe473624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:05 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Volume 76e17b53-1e4c-4f46-9e59-25b2ad358e7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76e17b53-1e4c-4f46-9e59-25b2ad358e7b', 'volume_size': 1} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Flow 'volume_create_manager' (6c365b45-dc3d-4773-af97-f0889d90923c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (417d0e06-30b4-46be-80d8-d2ba9a0edee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Flow 'volume_create_manager' (f3522d99-54ec-4236-acf0-045f39d06545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040bc575-c04a-4286-a5dd-3afd9234b5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (417d0e06-30b4-46be-80d8-d2ba9a0edee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1390057151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daae1a6d-665b-4cdd-945a-17fa7e848452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab15a9fb6cb1441ea8e3c93d2c74cae0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:05Z,use_quota=True,user_id='92c49c704ecd481db752ea49b21c3766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219e6b82-a57d-4824-be53-42ba42fa3dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219e6b82-a57d-4824-be53-42ba42fa3dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a534c9-b7ff-450b-9819-e2abe5551966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a534c9-b7ff-450b-9819-e2abe5551966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daae1a6d-665b-4cdd-945a-17fa7e848452', 'volume_name': 'volume-daae1a6d-665b-4cdd-945a-17fa7e848452', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8827c054-d7f5-4201-85ea-0c43525f9aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8827c054-d7f5-4201-85ea-0c43525f9aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c580c190-64ec-439c-9f1c-247f8281e2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:05 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Volume daae1a6d-665b-4cdd-945a-17fa7e848452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daae1a6d-665b-4cdd-945a-17fa7e848452', 'volume_size': 1} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-66cd4a10-423f-405e-8d31-4a1ae56518cd {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040bc575-c04a-4286-a5dd-3afd9234b5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1059825029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c3b8e5-7f61-46df-a82d-0e357cdf343d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3344caa34d405eb6db56eba0b7e138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:05Z,use_quota=True,user_id='a6b5b8db5d684287b9883b851747ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd6ea32-5bc2-49b4-8f0a-233b250798b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd6ea32-5bc2-49b4-8f0a-233b250798b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:05 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-66cd4a10-423f-405e-8d31-4a1ae56518cd Jul 24 09:47:05 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4558d2-7b4e-4dc8-a82a-778a9f4b7faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4558d2-7b4e-4dc8-a82a-778a9f4b7faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4c3b8e5-7f61-46df-a82d-0e357cdf343d', 'volume_name': 'volume-c4c3b8e5-7f61-46df-a82d-0e357cdf343d', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ef8f1e-50d8-4d1a-968d-41d1b51e7022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ef8f1e-50d8-4d1a-968d-41d1b51e7022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d96dd99-b9ca-4237-90f0-535f27f0f22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:05 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Volume c4c3b8e5-7f61-46df-a82d-0e357cdf343d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4c3b8e5-7f61-46df-a82d-0e357cdf343d', 'volume_size': 1} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:05 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-66cd4a10-423f-405e-8d31-4a1ae56518cd" returned: 0 in 0.311s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.646s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-773667784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe5c252-6c20-46ba-bbc2-112ae31d8dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3344caa34d405eb6db56eba0b7e138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:04Z,use_quota=True,user_id='a6b5b8db5d684287b9883b851747ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Creating volume 7fe5c252-6c20-46ba-bbc2-112ae31d8dbe {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:47:05 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:05 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe 1073741824 Jul 24 09:47:05 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7dcfa3-2954-4bbf-94fe-d67845ae10f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66cd4a10-423f-405e-8d31-4a1ae56518cd', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48f8cfd-c7fc-4a13-be8d-fc04008fc2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:05 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Volume volume-66cd4a10-423f-405e-8d31-4a1ae56518cd (66cd4a10-423f-405e-8d31-4a1ae56518cd): created successfully Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48f8cfd-c7fc-4a13-be8d-fc04008fc2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Flow 'volume_create_manager' (b33db76f-9265-4c1f-8874-1b69d15457db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:06 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-562d60a1-c064-4d50-a488-e6a7caf67a35 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Created volume successfully. Jul 24 09:47:06 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe 1073741824" returned: 0 in 0.528s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:06 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe Jul 24 09:47:06 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:06 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe" returned: 0 in 0.263s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:47:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.347s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1251506340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e17b53-1e4c-4f46-9e59-25b2ad358e7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3344caa34d405eb6db56eba0b7e138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:05Z,use_quota=True,user_id='a6b5b8db5d684287b9883b851747ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:47:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Creating volume 76e17b53-1e4c-4f46-9e59-25b2ad358e7b {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:47:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:47:06 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:47:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-76e17b53-1e4c-4f46-9e59-25b2ad358e7b 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d33ae86-507f-4992-b8fd-743554d2ec0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af51edc-bb72-4d1c-8315-e1effe3766a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:06 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-76e17b53-1e4c-4f46-9e59-25b2ad358e7b 1073741824 Jul 24 09:47:06 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:06 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Volume volume-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe (7fe5c252-6c20-46ba-bbc2-112ae31d8dbe): created successfully Jul 24 09:47:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af51edc-bb72-4d1c-8315-e1effe3766a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Flow 'volume_create_manager' (57364cb2-b3d4-4cb9-90d0-a5bb20155bfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:06 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-17fbf259-707c-48f6-92e0-9fbe8232b805 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Created volume successfully. Jul 24 09:47:07 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-76e17b53-1e4c-4f46-9e59-25b2ad358e7b 1073741824" returned: 0 in 0.614s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-76e17b53-1e4c-4f46-9e59-25b2ad358e7b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:07 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-76e17b53-1e4c-4f46-9e59-25b2ad358e7b Jul 24 09:47:07 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:07 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-76e17b53-1e4c-4f46-9e59-25b2ad358e7b" returned: 0 in 0.254s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:47:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.110s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1390057151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daae1a6d-665b-4cdd-945a-17fa7e848452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab15a9fb6cb1441ea8e3c93d2c74cae0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:05Z,use_quota=True,user_id='92c49c704ecd481db752ea49b21c3766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:47:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Creating volume daae1a6d-665b-4cdd-945a-17fa7e848452 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:47:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:47:07 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:47:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-daae1a6d-665b-4cdd-945a-17fa7e848452 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:07 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-daae1a6d-665b-4cdd-945a-17fa7e848452 1073741824 Jul 24 09:47:07 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5112143d-c6ec-4e9b-a02f-037ebe473624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76e17b53-1e4c-4f46-9e59-25b2ad358e7b', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (715e6382-9c7d-46a0-b526-bb30068ab1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:07 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Volume volume-76e17b53-1e4c-4f46-9e59-25b2ad358e7b (76e17b53-1e4c-4f46-9e59-25b2ad358e7b): created successfully Jul 24 09:47:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (715e6382-9c7d-46a0-b526-bb30068ab1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Flow 'volume_create_manager' (bf0828cc-1ae9-44dd-9eeb-8b015ce0416e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:07 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-18db12ec-bd13-45c5-a918-3ebd4d729ef3 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Created volume successfully. Jul 24 09:47:08 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-daae1a6d-665b-4cdd-945a-17fa7e848452 1073741824" returned: 0 in 0.576s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-daae1a6d-665b-4cdd-945a-17fa7e848452 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:08 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-daae1a6d-665b-4cdd-945a-17fa7e848452 Jul 24 09:47:08 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:08 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-daae1a6d-665b-4cdd-945a-17fa7e848452" returned: 0 in 0.286s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:47:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.916s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1059825029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c3b8e5-7f61-46df-a82d-0e357cdf343d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3344caa34d405eb6db56eba0b7e138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:05Z,use_quota=True,user_id='a6b5b8db5d684287b9883b851747ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:47:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Creating volume c4c3b8e5-7f61-46df-a82d-0e357cdf343d {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:47:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:47:08 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:47:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4c3b8e5-7f61-46df-a82d-0e357cdf343d 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c580c190-64ec-439c-9f1c-247f8281e2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daae1a6d-665b-4cdd-945a-17fa7e848452', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:08 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4c3b8e5-7f61-46df-a82d-0e357cdf343d 1073741824 Jul 24 09:47:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (776cf46c-ff50-46fb-8342-4024f3c1749a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:08 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:08 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Volume volume-daae1a6d-665b-4cdd-945a-17fa7e848452 (daae1a6d-665b-4cdd-945a-17fa7e848452): created successfully Jul 24 09:47:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (776cf46c-ff50-46fb-8342-4024f3c1749a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Flow 'volume_create_manager' (6c365b45-dc3d-4773-af97-f0889d90923c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:08 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-2e09b73f-4c5d-457d-a1ce-02f3d24e7dd5 tempest-VolumesTransfersV355Test-184965878 None] Created volume successfully. Jul 24 09:47:09 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4c3b8e5-7f61-46df-a82d-0e357cdf343d 1073741824" returned: 0 in 0.674s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4c3b8e5-7f61-46df-a82d-0e357cdf343d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:09 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4c3b8e5-7f61-46df-a82d-0e357cdf343d Jul 24 09:47:09 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:09 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eec089c8-d6bf-48a8-b026-805fa3289b08 tempest-VolumesTransfersV355Test-188663003 None] Acquiring lock "cinder-daae1a6d-665b-4cdd-945a-17fa7e848452-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:09 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eec089c8-d6bf-48a8-b026-805fa3289b08 tempest-VolumesTransfersV355Test-188663003 None] Lock "cinder-daae1a6d-665b-4cdd-945a-17fa7e848452-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:09 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eec089c8-d6bf-48a8-b026-805fa3289b08 tempest-VolumesTransfersV355Test-188663003 None] Acquiring lock "cinder-quobyte-daae1a6d-665b-4cdd-945a-17fa7e848452" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:09 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eec089c8-d6bf-48a8-b026-805fa3289b08 tempest-VolumesTransfersV355Test-188663003 None] Lock "cinder-quobyte-daae1a6d-665b-4cdd-945a-17fa7e848452" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:09 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0946aa49-0024-4f88-a726-673d0fa0d80d]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eec089c8-d6bf-48a8-b026-805fa3289b08 tempest-VolumesTransfersV355Test-188663003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-daae1a6d-665b-4cdd-945a-17fa7e848452 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:09 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4c3b8e5-7f61-46df-a82d-0e357cdf343d" returned: 0 in 0.356s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:47:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d96dd99-b9ca-4237-90f0-535f27f0f22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4c3b8e5-7f61-46df-a82d-0e357cdf343d', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fc684a-889a-41db-bf66-87a17b5e8c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:09 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-daae1a6d-665b-4cdd-945a-17fa7e848452 Jul 24 09:47:09 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:09 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Volume volume-c4c3b8e5-7f61-46df-a82d-0e357cdf343d (c4c3b8e5-7f61-46df-a82d-0e357cdf343d): created successfully Jul 24 09:47:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fc684a-889a-41db-bf66-87a17b5e8c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Flow 'volume_create_manager' (f3522d99-54ec-4236-acf0-045f39d06545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:09 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b7382e81-18e6-4723-b9ff-275509a07aa1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Created volume successfully. Jul 24 09:47:10 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eec089c8-d6bf-48a8-b026-805fa3289b08 tempest-VolumesTransfersV355Test-188663003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-daae1a6d-665b-4cdd-945a-17fa7e848452" returned: 0 in 0.460s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eec089c8-d6bf-48a8-b026-805fa3289b08 tempest-VolumesTransfersV355Test-188663003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-daae1a6d-665b-4cdd-945a-17fa7e848452 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:10 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-daae1a6d-665b-4cdd-945a-17fa7e848452 Jul 24 09:47:10 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:10 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eec089c8-d6bf-48a8-b026-805fa3289b08 tempest-VolumesTransfersV355Test-188663003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-daae1a6d-665b-4cdd-945a-17fa7e848452" returned: 0 in 0.324s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eec089c8-d6bf-48a8-b026-805fa3289b08 tempest-VolumesTransfersV355Test-188663003 None] Lock "cinder-quobyte-daae1a6d-665b-4cdd-945a-17fa7e848452" released by "delete_volume" :: held 0.857s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:10 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-eec089c8-d6bf-48a8-b026-805fa3289b08 tempest-VolumesTransfersV355Test-188663003 None] Created reservations ['58a77ada-333b-4412-a5f0-0b34311a8a26', 'c3627c3a-eb94-4d2d-898e-834e0df5abbb', 'e32c42ed-e0f7-4b55-aa22-08758f929c63', '0045cfc1-289e-48c4-bee8-fce651ad9403'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:47:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-eec089c8-d6bf-48a8-b026-805fa3289b08 tempest-VolumesTransfersV355Test-188663003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-eec089c8-d6bf-48a8-b026-805fa3289b08 tempest-VolumesTransfersV355Test-188663003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-eec089c8-d6bf-48a8-b026-805fa3289b08 tempest-VolumesTransfersV355Test-188663003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-eec089c8-d6bf-48a8-b026-805fa3289b08 tempest-VolumesTransfersV355Test-188663003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-eec089c8-d6bf-48a8-b026-805fa3289b08 tempest-VolumesTransfersV355Test-188663003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eec089c8-d6bf-48a8-b026-805fa3289b08 tempest-VolumesTransfersV355Test-188663003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:10 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:47:10 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0f023fc5-2db7-407e-a016-fa3264d7d6d1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "cinder-c4c3b8e5-7f61-46df-a82d-0e357cdf343d-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0f023fc5-2db7-407e-a016-fa3264d7d6d1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-c4c3b8e5-7f61-46df-a82d-0e357cdf343d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:11 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eec089c8-d6bf-48a8-b026-805fa3289b08 tempest-VolumesTransfersV355Test-188663003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.426s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:11 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-eec089c8-d6bf-48a8-b026-805fa3289b08 tempest-VolumesTransfersV355Test-188663003 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:47:11 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-eec089c8-d6bf-48a8-b026-805fa3289b08 tempest-VolumesTransfersV355Test-188663003 None] Deleted volume successfully. Jul 24 09:47:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eec089c8-d6bf-48a8-b026-805fa3289b08 tempest-VolumesTransfersV355Test-188663003 None] Lock "cinder-daae1a6d-665b-4cdd-945a-17fa7e848452-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0f023fc5-2db7-407e-a016-fa3264d7d6d1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "cinder-quobyte-c4c3b8e5-7f61-46df-a82d-0e357cdf343d" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0f023fc5-2db7-407e-a016-fa3264d7d6d1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-quobyte-c4c3b8e5-7f61-46df-a82d-0e357cdf343d" acquired by "delete_volume" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:11 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b9d8ce-d7aa-4371-9d6a-e839b33903ff]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0f023fc5-2db7-407e-a016-fa3264d7d6d1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4c3b8e5-7f61-46df-a82d-0e357cdf343d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:11 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4c3b8e5-7f61-46df-a82d-0e357cdf343d Jul 24 09:47:11 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:11 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0f023fc5-2db7-407e-a016-fa3264d7d6d1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4c3b8e5-7f61-46df-a82d-0e357cdf343d" returned: 0 in 0.432s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0f023fc5-2db7-407e-a016-fa3264d7d6d1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4c3b8e5-7f61-46df-a82d-0e357cdf343d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:11 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4c3b8e5-7f61-46df-a82d-0e357cdf343d Jul 24 09:47:11 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:11 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0f023fc5-2db7-407e-a016-fa3264d7d6d1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c4c3b8e5-7f61-46df-a82d-0e357cdf343d" returned: 0 in 0.289s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0f023fc5-2db7-407e-a016-fa3264d7d6d1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-quobyte-c4c3b8e5-7f61-46df-a82d-0e357cdf343d" released by "delete_volume" :: held 0.798s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:12 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-0f023fc5-2db7-407e-a016-fa3264d7d6d1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Created reservations ['929bde94-12e3-4e28-80ac-f9c1f1bd78d2', 'ecb6adf9-4633-425e-aa1b-2e5991e4b1c7', '1d054525-cac1-46fe-9b0c-16c1a8740144', 'e936b4ba-9c92-43e8-9885-b8d22c403cd9'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:47:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0f023fc5-2db7-407e-a016-fa3264d7d6d1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0f023fc5-2db7-407e-a016-fa3264d7d6d1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0f023fc5-2db7-407e-a016-fa3264d7d6d1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0f023fc5-2db7-407e-a016-fa3264d7d6d1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0f023fc5-2db7-407e-a016-fa3264d7d6d1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0f023fc5-2db7-407e-a016-fa3264d7d6d1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:12 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:47:12 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-da0911d8-177c-4cd9-867f-c250ffac8447 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "cinder-76e17b53-1e4c-4f46-9e59-25b2ad358e7b-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-da0911d8-177c-4cd9-867f-c250ffac8447 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-76e17b53-1e4c-4f46-9e59-25b2ad358e7b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-da0911d8-177c-4cd9-867f-c250ffac8447 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "cinder-quobyte-76e17b53-1e4c-4f46-9e59-25b2ad358e7b" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-da0911d8-177c-4cd9-867f-c250ffac8447 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-quobyte-76e17b53-1e4c-4f46-9e59-25b2ad358e7b" acquired by "delete_volume" :: waited 0.026s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:12 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57a4fcf-2f47-4be4-b430-57f5454331e2]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-da0911d8-177c-4cd9-867f-c250ffac8447 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-76e17b53-1e4c-4f46-9e59-25b2ad358e7b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:12 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0f023fc5-2db7-407e-a016-fa3264d7d6d1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.329s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:12 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-0f023fc5-2db7-407e-a016-fa3264d7d6d1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:47:12 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-0f023fc5-2db7-407e-a016-fa3264d7d6d1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Deleted volume successfully. Jul 24 09:47:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0f023fc5-2db7-407e-a016-fa3264d7d6d1 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-c4c3b8e5-7f61-46df-a82d-0e357cdf343d-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:12 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-76e17b53-1e4c-4f46-9e59-25b2ad358e7b Jul 24 09:47:12 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:12 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-da0911d8-177c-4cd9-867f-c250ffac8447 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-76e17b53-1e4c-4f46-9e59-25b2ad358e7b" returned: 0 in 0.524s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-da0911d8-177c-4cd9-867f-c250ffac8447 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-76e17b53-1e4c-4f46-9e59-25b2ad358e7b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:12 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-76e17b53-1e4c-4f46-9e59-25b2ad358e7b Jul 24 09:47:12 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:13 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-da0911d8-177c-4cd9-867f-c250ffac8447 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-76e17b53-1e4c-4f46-9e59-25b2ad358e7b" returned: 0 in 0.266s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-da0911d8-177c-4cd9-867f-c250ffac8447 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-quobyte-76e17b53-1e4c-4f46-9e59-25b2ad358e7b" released by "delete_volume" :: held 0.859s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:13 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-da0911d8-177c-4cd9-867f-c250ffac8447 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Created reservations ['4ded4043-5b2b-4d23-81a0-64328a798c18', 'e7027e94-98fd-4683-a972-6f238dbf6487', 'cdab613e-2ede-4286-bd49-1c2c40eddbe3', 'cd8fb636-028b-4441-b97d-32d06568109a'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:47:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-da0911d8-177c-4cd9-867f-c250ffac8447 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-da0911d8-177c-4cd9-867f-c250ffac8447 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-da0911d8-177c-4cd9-867f-c250ffac8447 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-da0911d8-177c-4cd9-867f-c250ffac8447 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-da0911d8-177c-4cd9-867f-c250ffac8447 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-da0911d8-177c-4cd9-867f-c250ffac8447 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:13 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:47:13 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c719bd46-3ac8-4b81-bcd3-a5eee9cbb919 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "cinder-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c719bd46-3ac8-4b81-bcd3-a5eee9cbb919 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c719bd46-3ac8-4b81-bcd3-a5eee9cbb919 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "cinder-quobyte-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c719bd46-3ac8-4b81-bcd3-a5eee9cbb919 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-quobyte-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:13 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ab9a8c-494d-4eab-b219-3b4e35634f0e]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c719bd46-3ac8-4b81-bcd3-a5eee9cbb919 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:13 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-da0911d8-177c-4cd9-867f-c250ffac8447 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.363s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:13 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-da0911d8-177c-4cd9-867f-c250ffac8447 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:47:13 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-da0911d8-177c-4cd9-867f-c250ffac8447 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Deleted volume successfully. Jul 24 09:47:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-da0911d8-177c-4cd9-867f-c250ffac8447 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-76e17b53-1e4c-4f46-9e59-25b2ad358e7b-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:13 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe Jul 24 09:47:13 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:14 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c719bd46-3ac8-4b81-bcd3-a5eee9cbb919 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe" returned: 0 in 0.447s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c719bd46-3ac8-4b81-bcd3-a5eee9cbb919 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:14 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe Jul 24 09:47:14 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:14 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c719bd46-3ac8-4b81-bcd3-a5eee9cbb919 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe" returned: 0 in 0.279s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:14 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c719bd46-3ac8-4b81-bcd3-a5eee9cbb919 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-quobyte-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe" released by "delete_volume" :: held 0.782s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:14 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-c719bd46-3ac8-4b81-bcd3-a5eee9cbb919 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Created reservations ['1e4841a3-8fea-47c1-9a04-c784358ea43b', '861fd553-b40f-4a82-a07a-2153f33f5bcd', 'cdedd79a-5ad3-4e79-9e74-778b7334dbeb', 'c0db7375-7ef3-4af1-90de-c5e9935fcb1c'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:47:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c719bd46-3ac8-4b81-bcd3-a5eee9cbb919 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c719bd46-3ac8-4b81-bcd3-a5eee9cbb919 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c719bd46-3ac8-4b81-bcd3-a5eee9cbb919 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c719bd46-3ac8-4b81-bcd3-a5eee9cbb919 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c719bd46-3ac8-4b81-bcd3-a5eee9cbb919 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c719bd46-3ac8-4b81-bcd3-a5eee9cbb919 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:14 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:47:14 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:14 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ec83f5ca-710f-4c72-8490-a4d2d10f78f8 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "cinder-66cd4a10-423f-405e-8d31-4a1ae56518cd-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:14 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ec83f5ca-710f-4c72-8490-a4d2d10f78f8 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-66cd4a10-423f-405e-8d31-4a1ae56518cd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:14 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ec83f5ca-710f-4c72-8490-a4d2d10f78f8 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "cinder-quobyte-66cd4a10-423f-405e-8d31-4a1ae56518cd" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:14 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ec83f5ca-710f-4c72-8490-a4d2d10f78f8 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-quobyte-66cd4a10-423f-405e-8d31-4a1ae56518cd" acquired by "delete_volume" :: waited 0.023s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:14 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc8deac-611f-4bf3-b379-007347a1be38]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec83f5ca-710f-4c72-8490-a4d2d10f78f8 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-66cd4a10-423f-405e-8d31-4a1ae56518cd {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:14 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c719bd46-3ac8-4b81-bcd3-a5eee9cbb919 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.368s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:14 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-c719bd46-3ac8-4b81-bcd3-a5eee9cbb919 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:47:14 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c719bd46-3ac8-4b81-bcd3-a5eee9cbb919 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Deleted volume successfully. Jul 24 09:47:14 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c719bd46-3ac8-4b81-bcd3-a5eee9cbb919 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-7fe5c252-6c20-46ba-bbc2-112ae31d8dbe-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:14 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-66cd4a10-423f-405e-8d31-4a1ae56518cd Jul 24 09:47:14 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:15 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:47:15 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:15 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec83f5ca-710f-4c72-8490-a4d2d10f78f8 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-66cd4a10-423f-405e-8d31-4a1ae56518cd" returned: 0 in 0.423s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec83f5ca-710f-4c72-8490-a4d2d10f78f8 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-66cd4a10-423f-405e-8d31-4a1ae56518cd {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:15 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-66cd4a10-423f-405e-8d31-4a1ae56518cd Jul 24 09:47:15 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:15 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.375s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 28 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:47:15 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec83f5ca-710f-4c72-8490-a4d2d10f78f8 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-66cd4a10-423f-405e-8d31-4a1ae56518cd" returned: 0 in 0.330s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ec83f5ca-710f-4c72-8490-a4d2d10f78f8 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-quobyte-66cd4a10-423f-405e-8d31-4a1ae56518cd" released by "delete_volume" :: held 0.809s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-ec83f5ca-710f-4c72-8490-a4d2d10f78f8 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Created reservations ['84ddc8b5-e161-43d0-a977-bd8b7b96f794', '0e04099c-43d8-4c13-9806-f8b218783412', '900c41c7-7c23-4307-8a0b-564ea34aec81', 'ef0a1811-615f-4f21-9ada-3d6b5c019f62'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ec83f5ca-710f-4c72-8490-a4d2d10f78f8 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ec83f5ca-710f-4c72-8490-a4d2d10f78f8 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ec83f5ca-710f-4c72-8490-a4d2d10f78f8 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ec83f5ca-710f-4c72-8490-a4d2d10f78f8 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ec83f5ca-710f-4c72-8490-a4d2d10f78f8 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec83f5ca-710f-4c72-8490-a4d2d10f78f8 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:15 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:47:15 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-deb342be-208e-43bb-9413-5ed093dc940b tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "cinder-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:15 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-deb342be-208e-43bb-9413-5ed093dc940b tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:16 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec83f5ca-710f-4c72-8490-a4d2d10f78f8 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.300s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:16 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-ec83f5ca-710f-4c72-8490-a4d2d10f78f8 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:47:16 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-deb342be-208e-43bb-9413-5ed093dc940b tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "cinder-quobyte-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:16 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-ec83f5ca-710f-4c72-8490-a4d2d10f78f8 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Deleted volume successfully. Jul 24 09:47:16 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-deb342be-208e-43bb-9413-5ed093dc940b tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-quobyte-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96" acquired by "delete_volume" :: waited 0.029s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:16 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ec83f5ca-710f-4c72-8490-a4d2d10f78f8 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-66cd4a10-423f-405e-8d31-4a1ae56518cd-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:16 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caea36b-984b-418e-a7ed-8c9672f2a806]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-deb342be-208e-43bb-9413-5ed093dc940b tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:16 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96 Jul 24 09:47:16 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:16 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-deb342be-208e-43bb-9413-5ed093dc940b tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96" returned: 0 in 0.483s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-deb342be-208e-43bb-9413-5ed093dc940b tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:16 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96 Jul 24 09:47:16 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:16 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-deb342be-208e-43bb-9413-5ed093dc940b tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96" returned: 0 in 0.280s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:16 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-deb342be-208e-43bb-9413-5ed093dc940b tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-quobyte-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96" released by "delete_volume" :: held 0.863s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:17 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-deb342be-208e-43bb-9413-5ed093dc940b tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Created reservations ['31d9e0ad-11f8-463b-9c5b-8e359e057502', '97d799f3-c515-409e-8cdd-4dd59c4fa126', 'ee16818f-2496-42ad-8ebb-8ecafbd1dbc2', 'c9710a67-c235-4038-83a1-9f4042a4290b'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:47:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-deb342be-208e-43bb-9413-5ed093dc940b tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-deb342be-208e-43bb-9413-5ed093dc940b tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:17 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-deb342be-208e-43bb-9413-5ed093dc940b tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:17 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-deb342be-208e-43bb-9413-5ed093dc940b tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-deb342be-208e-43bb-9413-5ed093dc940b tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-deb342be-208e-43bb-9413-5ed093dc940b tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:17 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:47:17 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d0859020-c505-4a77-a682-320c4459d8f5 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "cinder-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d0859020-c505-4a77-a682-320c4459d8f5 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d0859020-c505-4a77-a682-320c4459d8f5 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "cinder-quobyte-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d0859020-c505-4a77-a682-320c4459d8f5 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-quobyte-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c" acquired by "delete_volume" :: waited 0.038s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:17 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4afd05-7abe-449b-93a3-88ae2842dd65]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d0859020-c505-4a77-a682-320c4459d8f5 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:17 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c Jul 24 09:47:17 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:17 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-deb342be-208e-43bb-9413-5ed093dc940b tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.517s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:17 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-deb342be-208e-43bb-9413-5ed093dc940b tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:47:17 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-deb342be-208e-43bb-9413-5ed093dc940b tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Deleted volume successfully. Jul 24 09:47:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-deb342be-208e-43bb-9413-5ed093dc940b tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-cc0d8f06-30ee-4340-a931-e6cbc0c6cf96-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:17 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d0859020-c505-4a77-a682-320c4459d8f5 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c" returned: 0 in 0.425s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d0859020-c505-4a77-a682-320c4459d8f5 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:17 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c Jul 24 09:47:17 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:18 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d0859020-c505-4a77-a682-320c4459d8f5 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c" returned: 0 in 0.269s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:18 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d0859020-c505-4a77-a682-320c4459d8f5 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-quobyte-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c" released by "delete_volume" :: held 0.764s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:18 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-d0859020-c505-4a77-a682-320c4459d8f5 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Created reservations ['9444937c-a105-4a28-8039-0e39d31e84d0', '639b669e-eb55-4d62-bd25-7c6f6c3c09f9', '7a99858f-2c69-4955-a3ac-1abbdf0e773f', '82212932-8ee7-4108-9a0d-163395e770ef'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:47:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d0859020-c505-4a77-a682-320c4459d8f5 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d0859020-c505-4a77-a682-320c4459d8f5 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d0859020-c505-4a77-a682-320c4459d8f5 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d0859020-c505-4a77-a682-320c4459d8f5 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d0859020-c505-4a77-a682-320c4459d8f5 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d0859020-c505-4a77-a682-320c4459d8f5 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:18 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:47:18 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:18 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d0859020-c505-4a77-a682-320c4459d8f5 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.279s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:18 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-d0859020-c505-4a77-a682-320c4459d8f5 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:47:18 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d0859020-c505-4a77-a682-320c4459d8f5 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Deleted volume successfully. Jul 24 09:47:18 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d0859020-c505-4a77-a682-320c4459d8f5 tempest-CreateVolumesFromSourceVolumeTest-1220318897 None] Lock "cinder-0d64cd29-a1b0-4c9a-91f7-9e2140d1454c-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Flow 'volume_create_manager' (86ac27be-96a1-49a6-b485-c989ef0a45c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c52e985-84f7-4f87-89e4-657a38570a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c52e985-84f7-4f87-89e4-657a38570a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-755640475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef0f08b-3aed-43ac-a00d-664d4a22b42b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4441b6285f3e40fc84a22247232c69a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:26Z,use_quota=True,user_id='e84784b87c544796b62801a2a0ee2312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ef870b-5975-4f99-875f-bfa124c08623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ef870b-5975-4f99-875f-bfa124c08623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ff7f4e-9194-46dc-a359-e775711b0645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ff7f4e-9194-46dc-a359-e775711b0645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ef0f08b-3aed-43ac-a00d-664d4a22b42b', 'volume_name': 'volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (626c904b-0952-46e7-8906-21ccd347a0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (626c904b-0952-46e7-8906-21ccd347a0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a657462-aa12-47e3-9afb-1c8f0d0fae2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:25 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Volume 5ef0f08b-3aed-43ac-a00d-664d4a22b42b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b', 'volume_size': 1} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-755640475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef0f08b-3aed-43ac-a00d-664d4a22b42b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4441b6285f3e40fc84a22247232c69a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:26Z,use_quota=True,user_id='e84784b87c544796b62801a2a0ee2312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Creating volume 5ef0f08b-3aed-43ac-a00d-664d4a22b42b {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:47:25 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:47:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:25 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b 1073741824 Jul 24 09:47:25 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:26 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b 1073741824" returned: 0 in 0.610s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:26 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b Jul 24 09:47:26 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:26 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b" returned: 0 in 0.295s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:47:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a657462-aa12-47e3-9afb-1c8f0d0fae2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecad10ca-a12d-491c-b442-d6518661f295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:26 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Volume volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b (5ef0f08b-3aed-43ac-a00d-664d4a22b42b): created successfully Jul 24 09:47:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecad10ca-a12d-491c-b442-d6518661f295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Flow 'volume_create_manager' (86ac27be-96a1-49a6-b485-c989ef0a45c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:26 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b5a8c947-6ff6-459b-b852-c9f1264f95a0 tempest-VolumeDependencyTests-150032330 None] Created volume successfully. Jul 24 09:47:27 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:47:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Flow 'volume_create_manager' (0d42f541-562d-4356-8180-35bbf2f9b528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d50b29b-b37c-41f8-bf05-26b5fffe6a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d50b29b-b37c-41f8-bf05-26b5fffe6a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1656332011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1812af6a-17c6-4573-aa4a-c86d480ad012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f97a8c644a8442dba50918f9eda2c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:27Z,use_quota=True,user_id='dec2c4eacf7a49d58c1748aa79b6de07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76761d4a-0356-4abf-be8c-7f18be3967af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76761d4a-0356-4abf-be8c-7f18be3967af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c6ef8b-ed1d-46ad-850f-97283331f6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:27 devstack cinder-volume[88488]: DEBUG cinder.image.glance [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Creating Keystone auth plugin from conf {{(pid=88488) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 09:47:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c6ef8b-ed1d-46ad-850f-97283331f6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1812af6a-17c6-4573-aa4a-c86d480ad012', 'volume_name': 'volume-1812af6a-17c6-4573-aa4a-c86d480ad012', 'volume_size': 1, 'image_id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3181d69d4e349c08df0ab05faa1a57c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'created_at': datetime.datetime(2026, 7, 24, 7, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4687413a-6890-48c5-b9ff-ca6648412e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4687413a-6890-48c5-b9ff-ca6648412e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c27ae8-cfc7-44ba-a2fd-9b360a91548a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:27 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Volume 1812af6a-17c6-4573-aa4a-c86d480ad012: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1812af6a-17c6-4573-aa4a-c86d480ad012', 'volume_size': 1, 'image_id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3181d69d4e349c08df0ab05faa1a57c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'created_at': datetime.datetime(2026, 7, 24, 7, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 24 09:47:27 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Trying to clone 1812af6a-17c6-4573-aa4a-c86d480ad012 from image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc at location (None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}]). {{(pid=88488) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 09:47:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ef4f7d5e-18c4-4ae1-8e6d-0a1c0c45020e tempest-VolumeDependencyTests-150032330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ef4f7d5e-18c4-4ae1-8e6d-0a1c0c45020e tempest-VolumeDependencyTests-150032330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-ef4f7d5e-18c4-4ae1-8e6d-0a1c0c45020e tempest-VolumeDependencyTests-150032330 None] Creating offline snapshot 551c8b10-aaef-4992-bf3a-7a6e835ed1b2 of volume 5ef0f08b-3aed-43ac-a00d-664d4a22b42b {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:47:28 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4dd443-da5d-4aeb-9b68-453c4cff729c]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ef4f7d5e-18c4-4ae1-8e6d-0a1c0c45020e tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:28 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b Jul 24 09:47:28 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:28 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_8raef6srdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 09:47:28 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Image download 20.69 MB at 20.69 MB/s Jul 24 09:47:28 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[575bd1bc-9233-42b1-9887-c80640611542]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_8raef6srdevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:28 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ef4f7d5e-18c4-4ae1-8e6d-0a1c0c45020e tempest-VolumeDependencyTests-150032330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b" returned: 0 in 0.729s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ef4f7d5e-18c4-4ae1-8e6d-0a1c0c45020e tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:28 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_8raef6srdevstack@QuobyteHD Jul 24 09:47:28 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:28 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2 1G Jul 24 09:47:28 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=220,cinder:SELECT=158,cinder:INSERT=55,cinder:DELETE=18 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:47:29 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Flow 'volume_create_manager' (75dec5b2-82ac-4cde-8773-ef58f70f1c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaced338-f4ee-4dbd-9e06-1caf69fe7ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_8raef6srdevstack@QuobyteHD" returned: 0 in 0.597s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Temporary image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc is fetched for user dec2c4eacf7a49d58c1748aa79b6de07. {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaced338-f4ee-4dbd-9e06-1caf69fe7ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1056116661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e1238c-896c-4360-9df0-95c0f2fb6b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16e06cd986c4322a3a577eba30ea358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:29Z,use_quota=True,user_id='786e00245d894ab3a79e6347dc76a1f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5eaa10-acbe-4e6d-ae81-ce5005d758ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5eaa10-acbe-4e6d-ae81-ce5005d758ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ea539a-7c15-44a0-9530-603a5de85672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ea539a-7c15-44a0-9530-603a5de85672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83e1238c-896c-4360-9df0-95c0f2fb6b83', 'volume_name': 'volume-83e1238c-896c-4360-9df0-95c0f2fb6b83', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817c2c22-77c3-43d6-8672-80e699b0b632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817c2c22-77c3-43d6-8672-80e699b0b632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780f8260-bbdb-4655-b0a9-f93407dd9b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:29 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Volume 83e1238c-896c-4360-9df0-95c0f2fb6b83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83e1238c-896c-4360-9df0-95c0f2fb6b83', 'volume_size': 1} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:47:29 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Flow 'volume_create_manager' (b8054e1e-7c48-417b-9f86-092682df5fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228b383d-5397-463f-acc6-797b051a70d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=160,cinder:INSERT=57,cinder:UPDATE=216,cinder:DELETE=19 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ef4f7d5e-18c4-4ae1-8e6d-0a1c0c45020e tempest-VolumeDependencyTests-150032330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2 1G" returned: 0 in 0.586s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ef4f7d5e-18c4-4ae1-8e6d-0a1c0c45020e tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:29 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2 Jul 24 09:47:29 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228b383d-5397-463f-acc6-797b051a70d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1349374101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e58afd74-d43a-44d9-b3ca-28d121d76081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3457802bc2b34831afd7aade300294c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:29Z,use_quota=True,user_id='a72de313c231466c875ce495f3e132bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (900c3732-cdcf-440e-ba87-20ae9c73cc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (900c3732-cdcf-440e-ba87-20ae9c73cc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0714c1-0fa9-458f-80c9-e2062fbf3d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0714c1-0fa9-458f-80c9-e2062fbf3d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e58afd74-d43a-44d9-b3ca-28d121d76081', 'volume_name': 'volume-e58afd74-d43a-44d9-b3ca-28d121d76081', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16921b7b-3a49-4599-838b-96f88c995dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16921b7b-3a49-4599-838b-96f88c995dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd0daef-54d5-4384-a536-d23d43a02559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:29 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Volume e58afd74-d43a-44d9-b3ca-28d121d76081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e58afd74-d43a-44d9-b3ca-28d121d76081', 'volume_size': 1} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d061f7b1-82f6-421e-b6e1-f89143da6c05]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_8raef6srdevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:29 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_8raef6srdevstack@QuobyteHD Jul 24 09:47:29 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:29 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ef4f7d5e-18c4-4ae1-8e6d-0a1c0c45020e tempest-VolumeDependencyTests-150032330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2" returned: 0 in 0.324s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:29 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-ef4f7d5e-18c4-4ae1-8e6d-0a1c0c45020e tempest-VolumeDependencyTests-150032330 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2 is being set with open permissions: ugo+rw Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ef4f7d5e-18c4-4ae1-8e6d-0a1c0c45020e tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:29 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2 Jul 24 09:47:29 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:29 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_8raef6srdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:29 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ef4f7d5e-18c4-4ae1-8e6d-0a1c0c45020e tempest-VolumeDependencyTests-150032330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2" returned: 0 in 0.243s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ef4f7d5e-18c4-4ae1-8e6d-0a1c0c45020e tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:30 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.info Jul 24 09:47:30 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:30 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ef4f7d5e-18c4-4ae1-8e6d-0a1c0c45020e tempest-VolumeDependencyTests-150032330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.info" returned: 0 in 0.242s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:30 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-ef4f7d5e-18c4-4ae1-8e6d-0a1c0c45020e tempest-VolumeDependencyTests-150032330 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.info is being set with open permissions: ugo+rw Jul 24 09:47:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ef4f7d5e-18c4-4ae1-8e6d-0a1c0c45020e tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:30 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.info Jul 24 09:47:30 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:30 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ef4f7d5e-18c4-4ae1-8e6d-0a1c0c45020e tempest-VolumeDependencyTests-150032330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.info" returned: 0 in 0.249s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ef4f7d5e-18c4-4ae1-8e6d-0a1c0c45020e tempest-VolumeDependencyTests-150032330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.481s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.173s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:30 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1056116661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e1238c-896c-4360-9df0-95c0f2fb6b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16e06cd986c4322a3a577eba30ea358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:29Z,use_quota=True,user_id='786e00245d894ab3a79e6347dc76a1f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:47:30 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Creating volume 83e1238c-896c-4360-9df0-95c0f2fb6b83 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:47:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:30 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:30 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:30 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:47:30 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:47:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-83e1238c-896c-4360-9df0-95c0f2fb6b83 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:30 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-83e1238c-896c-4360-9df0-95c0f2fb6b83 1073741824 Jul 24 09:47:30 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:30 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-ef4f7d5e-18c4-4ae1-8e6d-0a1c0c45020e tempest-VolumeDependencyTests-150032330 None] Create snapshot completed successfully Jul 24 09:47:30 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-83e1238c-896c-4360-9df0-95c0f2fb6b83 1073741824" returned: 0 in 0.407s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-83e1238c-896c-4360-9df0-95c0f2fb6b83 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:30 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-83e1238c-896c-4360-9df0-95c0f2fb6b83 Jul 24 09:47:30 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:31 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-83e1238c-896c-4360-9df0-95c0f2fb6b83" returned: 0 in 0.237s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.732s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1349374101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e58afd74-d43a-44d9-b3ca-28d121d76081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3457802bc2b34831afd7aade300294c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:29Z,use_quota=True,user_id='a72de313c231466c875ce495f3e132bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Creating volume e58afd74-d43a-44d9-b3ca-28d121d76081 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:47:31 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780f8260-bbdb-4655-b0a9-f93407dd9b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83e1238c-896c-4360-9df0-95c0f2fb6b83', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:31 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081 1073741824 Jul 24 09:47:31 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76b189e-0fd5-4dd6-a1b3-5dc59d9db704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:31 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Volume volume-83e1238c-896c-4360-9df0-95c0f2fb6b83 (83e1238c-896c-4360-9df0-95c0f2fb6b83): created successfully Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76b189e-0fd5-4dd6-a1b3-5dc59d9db704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Flow 'volume_create_manager' (75dec5b2-82ac-4cde-8773-ef58f70f1c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:31 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-fb0bbfea-bedf-4272-9d4c-a3c91bc229c0 tempest-VolumesTransfersV357Test-2003528950 None] Created volume successfully. Jul 24 09:47:31 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081 1073741824" returned: 0 in 0.408s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:31 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081 Jul 24 09:47:31 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:31 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081" returned: 0 in 0.289s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.105s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1656332011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1812af6a-17c6-4573-aa4a-c86d480ad012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f97a8c644a8442dba50918f9eda2c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:27Z,use_quota=True,user_id='dec2c4eacf7a49d58c1748aa79b6de07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Creating volume 1812af6a-17c6-4573-aa4a-c86d480ad012 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:47:31 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1812af6a-17c6-4573-aa4a-c86d480ad012 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:31 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd0daef-54d5-4384-a536-d23d43a02559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e58afd74-d43a-44d9-b3ca-28d121d76081', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60175ff1-2b35-408c-9b67-ffeb89c26446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:32 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1812af6a-17c6-4573-aa4a-c86d480ad012 1073741824 Jul 24 09:47:32 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:32 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Volume volume-e58afd74-d43a-44d9-b3ca-28d121d76081 (e58afd74-d43a-44d9-b3ca-28d121d76081): created successfully Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60175ff1-2b35-408c-9b67-ffeb89c26446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Flow 'volume_create_manager' (b8054e1e-7c48-417b-9f86-092682df5fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:32 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-57571379-d75f-4052-b427-bb5574e022e9 tempest-VolumesSnapshotTestJSON-1116693304 None] Created volume successfully. Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Flow 'volume_create_manager' (017e19f2-f5c3-49a9-a869-1bac65136ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ba4457-ab6c-457b-82c7-f595b3e40925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ba4457-ab6c-457b-82c7-f595b3e40925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1329250880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a923ba3-e424-4699-814b-4ab916564720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4441b6285f3e40fc84a22247232c69a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=551c8b10-aaef-4992-bf3a-7a6e835ed1b2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:32Z,use_quota=True,user_id='e84784b87c544796b62801a2a0ee2312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb27dfde-820e-42b8-a100-2674a947a4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb27dfde-820e-42b8-a100-2674a947a4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a2ec75-cc40-4fb3-b083-9d1182af8f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a2ec75-cc40-4fb3-b083-9d1182af8f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9a923ba3-e424-4699-814b-4ab916564720', 'volume_name': 'volume-9a923ba3-e424-4699-814b-4ab916564720', 'volume_size': 1, 'snapshot_id': '551c8b10-aaef-4992-bf3a-7a6e835ed1b2'}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72780f97-7c93-4a0b-aaf8-d382ef2d12ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72780f97-7c93-4a0b-aaf8-d382ef2d12ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (addb4c6a-4da4-469a-a218-246f800b923b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:32 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Volume 9a923ba3-e424-4699-814b-4ab916564720: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9a923ba3-e424-4699-814b-4ab916564720', 'volume_size': 1, 'snapshot_id': '551c8b10-aaef-4992-bf3a-7a6e835ed1b2'} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-795aad28-3932-460f-bf5c-0971f197c3c4 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:32 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1812af6a-17c6-4573-aa4a-c86d480ad012 1073741824" returned: 0 in 0.673s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1812af6a-17c6-4573-aa4a-c86d480ad012 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:32 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1812af6a-17c6-4573-aa4a-c86d480ad012 Jul 24 09:47:32 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:32 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-5a8bfdb9-4edc-4113-94f9-d74d4a499560 tempest-VolumesTransfersV357Test-1788141061 None] Transfer volume completed successfully. Jul 24 09:47:32 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1812af6a-17c6-4573-aa4a-c86d480ad012" returned: 0 in 0.263s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.443s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Acquiring lock "cinder-quobyte-551c8b10-aaef-4992-bf3a-7a6e835ed1b2-9a923ba3-e424-4699-814b-4ab916564720" by "_create_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Lock "cinder-quobyte-551c8b10-aaef-4992-bf3a-7a6e835ed1b2-9a923ba3-e424-4699-814b-4ab916564720" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Creating volume 9a923ba3-e424-4699-814b-4ab916564720 from snapshot 551c8b10-aaef-4992-bf3a-7a6e835ed1b2 {{(pid=88488) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Acquiring lock "cinder-quobyte-9a923ba3-e424-4699-814b-4ab916564720" by "_copy_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Attempting download of ce0135c3-cdf3-4327-98f4-fcc81dc66bbc ((None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}])) to volume 1812af6a-17c6-4573-aa4a-c86d480ad012. {{(pid=88488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Lock "cinder-quobyte-9a923ba3-e424-4699-814b-4ab916564720" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] snapshot: 551c8b10-aaef-4992-bf3a-7a6e835ed1b2, volume: 9a923ba3-e424-4699-814b-4ab916564720, {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[11201374-8c76-476c-840f-d13f4cd8217d]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[efba178d-25d0-4549-a36f-077428cef4a6]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_0g1x7rpa {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:33 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2 Jul 24 09:47:33 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:33 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_0g1x7rpa Jul 24 09:47:33 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-80617f23-ddd8-462c-8a0e-b5d51e6caa3e tempest-VolumesTransfersV357Test-214279374 None] Acquiring lock "cinder-83e1238c-896c-4360-9df0-95c0f2fb6b83-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-80617f23-ddd8-462c-8a0e-b5d51e6caa3e tempest-VolumesTransfersV357Test-214279374 None] Lock "cinder-83e1238c-896c-4360-9df0-95c0f2fb6b83-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-80617f23-ddd8-462c-8a0e-b5d51e6caa3e tempest-VolumesTransfersV357Test-214279374 None] Acquiring lock "cinder-quobyte-83e1238c-896c-4360-9df0-95c0f2fb6b83" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-80617f23-ddd8-462c-8a0e-b5d51e6caa3e tempest-VolumesTransfersV357Test-214279374 None] Lock "cinder-quobyte-83e1238c-896c-4360-9df0-95c0f2fb6b83" acquired by "delete_volume" :: waited 0.024s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[008ca3f3-780f-4bae-af4c-e5774d81bb77]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-80617f23-ddd8-462c-8a0e-b5d51e6caa3e tempest-VolumesTransfersV357Test-214279374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-83e1238c-896c-4360-9df0-95c0f2fb6b83 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:33 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-83e1238c-896c-4360-9df0-95c0f2fb6b83 Jul 24 09:47:33 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:33 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2" returned: 0 in 0.398s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Creating direct copy from snapshot {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 09:47:33 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_0g1x7rpa" returned: 0 in 0.389s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_0g1x7rpa {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd295df-3ee6-4f15-81e7-39ac9b761b4c]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:33 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_0g1x7rpa Jul 24 09:47:33 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:33 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b Jul 24 09:47:33 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:33 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-80617f23-ddd8-462c-8a0e-b5d51e6caa3e tempest-VolumesTransfersV357Test-214279374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-83e1238c-896c-4360-9df0-95c0f2fb6b83" returned: 0 in 0.391s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-80617f23-ddd8-462c-8a0e-b5d51e6caa3e tempest-VolumesTransfersV357Test-214279374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-83e1238c-896c-4360-9df0-95c0f2fb6b83 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:33 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-83e1238c-896c-4360-9df0-95c0f2fb6b83 Jul 24 09:47:33 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:33 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_0g1x7rpa" returned: 1 in 0.364s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_0g1x7rpa' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73e1038-f82e-45c9-a35a-9d2b3b76566d]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_8raef6srdevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:33 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b" returned: 0 in 0.446s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG cinder.utils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Path /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9a923ba3-e424-4699-814b-4ab916564720 not found in is_blk_device check {{(pid=88488) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9a923ba3-e424-4699-814b-4ab916564720 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:33 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_8raef6srdevstack@QuobyteHD Jul 24 09:47:33 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:33 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9a923ba3-e424-4699-814b-4ab916564720 Jul 24 09:47:33 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:33 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-80617f23-ddd8-462c-8a0e-b5d51e6caa3e tempest-VolumesTransfersV357Test-214279374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-83e1238c-896c-4360-9df0-95c0f2fb6b83" returned: 0 in 0.248s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-80617f23-ddd8-462c-8a0e-b5d51e6caa3e tempest-VolumesTransfersV357Test-214279374 None] Lock "cinder-quobyte-83e1238c-896c-4360-9df0-95c0f2fb6b83" released by "delete_volume" :: held 0.693s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:34 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-80617f23-ddd8-462c-8a0e-b5d51e6caa3e tempest-VolumesTransfersV357Test-214279374 None] Created reservations ['43ca3f83-b356-4c2c-a089-ef7d9f881102', '3485797a-1bb7-4ed4-92c6-63e8e4037987', '0a06cfcb-5ee5-4bfb-9e30-584de5e63e78', '57a4fe96-72f2-45bf-bd4c-2ca7431d5fb5'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:47:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-80617f23-ddd8-462c-8a0e-b5d51e6caa3e tempest-VolumesTransfersV357Test-214279374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-80617f23-ddd8-462c-8a0e-b5d51e6caa3e tempest-VolumesTransfersV357Test-214279374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:34 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-80617f23-ddd8-462c-8a0e-b5d51e6caa3e tempest-VolumesTransfersV357Test-214279374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:34 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-80617f23-ddd8-462c-8a0e-b5d51e6caa3e tempest-VolumesTransfersV357Test-214279374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-80617f23-ddd8-462c-8a0e-b5d51e6caa3e tempest-VolumesTransfersV357Test-214279374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-80617f23-ddd8-462c-8a0e-b5d51e6caa3e tempest-VolumesTransfersV357Test-214279374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:34 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:47:34 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:34 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_8raef6srdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:34 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] ce0135c3-cdf3-4327-98f4-fcc81dc66bbc was qcow2, converting to qcow2 {{(pid=88488) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 09:47:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_8raef6srdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1812af6a-17c6-4573-aa4a-c86d480ad012 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:34 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_8raef6srdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1812af6a-17c6-4573-aa4a-c86d480ad012 Jul 24 09:47:34 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:34 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-80617f23-ddd8-462c-8a0e-b5d51e6caa3e tempest-VolumesTransfersV357Test-214279374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.260s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:34 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-80617f23-ddd8-462c-8a0e-b5d51e6caa3e tempest-VolumesTransfersV357Test-214279374 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:47:34 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-80617f23-ddd8-462c-8a0e-b5d51e6caa3e tempest-VolumesTransfersV357Test-214279374 None] Deleted volume successfully. Jul 24 09:47:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-80617f23-ddd8-462c-8a0e-b5d51e6caa3e tempest-VolumesTransfersV357Test-214279374 None] Lock "cinder-83e1238c-896c-4360-9df0-95c0f2fb6b83-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:35 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:47:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Flow 'volume_create_manager' (f6ad0ced-88bd-45c9-a776-831847cf8a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ad2b02-726d-49fa-9e37-6807de628f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ad2b02-726d-49fa-9e37-6807de628f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1097291560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16e06cd986c4322a3a577eba30ea358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:36Z,use_quota=True,user_id='786e00245d894ab3a79e6347dc76a1f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3b66ce-b05e-48f0-b4e7-bcd7e9e6c0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3b66ce-b05e-48f0-b4e7-bcd7e9e6c0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd1d1a2-f794-444f-aa90-54191532c8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd1d1a2-f794-444f-aa90-54191532c8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a', 'volume_name': 'volume-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3dbc9c5-4249-4db2-a015-a30cfce29982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3dbc9c5-4249-4db2-a015-a30cfce29982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18b7e90-edc7-4d5c-9262-81506bc8d73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:35 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Volume ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a', 'volume_size': 1} Jul 24 09:47:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:37 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_8raef6srdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1812af6a-17c6-4573-aa4a-c86d480ad012" returned: 0 in 3.561s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:37 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_8raef6srdevstack@QuobyteHD, size 112.00 MB, duration 3.56 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1812af6a-17c6-4573-aa4a-c86d480ad012 {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:47:37 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Converted 112.00 MB image at 31.43 MB/s Jul 24 09:47:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1812af6a-17c6-4573-aa4a-c86d480ad012 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:37 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1812af6a-17c6-4573-aa4a-c86d480ad012 1G Jul 24 09:47:37 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:38 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1812af6a-17c6-4573-aa4a-c86d480ad012 1G" returned: 0 in 0.652s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:38 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Downloaded image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc ((None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}])) to volume 1812af6a-17c6-4573-aa4a-c86d480ad012 successfully. {{(pid=88488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 09:47:38 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Temporary image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc for user dec2c4eacf7a49d58c1748aa79b6de07 is deleted. {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 09:47:38 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Marking volume 1812af6a-17c6-4573-aa4a-c86d480ad012 as bootable. {{(pid=88488) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 09:47:38 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Copying metadata from image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc to 1812af6a-17c6-4573-aa4a-c86d480ad012. {{(pid=88488) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 09:47:38 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Creating volume glance metadata for volume 1812af6a-17c6-4573-aa4a-c86d480ad012 backed by image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88488) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 09:47:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c27ae8-cfc7-44ba-a2fd-9b360a91548a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1812af6a-17c6-4573-aa4a-c86d480ad012', 'volume_size': 1, 'image_id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3181d69d4e349c08df0ab05faa1a57c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'created_at': datetime.datetime(2026, 7, 24, 7, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce475d8c-efb8-4baa-894f-1c529d48b0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:38 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Volume volume-1812af6a-17c6-4573-aa4a-c86d480ad012 (1812af6a-17c6-4573-aa4a-c86d480ad012): created successfully Jul 24 09:47:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce475d8c-efb8-4baa-894f-1c529d48b0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Flow 'volume_create_manager' (0d42f541-562d-4356-8180-35bbf2f9b528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:38 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-54baf2fc-d428-495d-9258-2f025049a6be tempest-TestShelveInstance-710840937 None] Created volume successfully. Jul 24 09:47:38 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9a923ba3-e424-4699-814b-4ab916564720" returned: 0 in 5.037s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:38 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ddbbcb-aacc-45ae-bbec-162d729c75c6]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:39 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b Jul 24 09:47:39 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:39 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b" returned: 0 in 0.522s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:39 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b, size 1024.00 MB, duration 5.04 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9a923ba3-e424-4699-814b-4ab916564720 {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:47:39 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Converted 1024.00 MB image at 203.24 MB/s Jul 24 09:47:39 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9a923ba3-e424-4699-814b-4ab916564720 is being set with open permissions: ugo+rw Jul 24 09:47:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9a923ba3-e424-4699-814b-4ab916564720 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:39 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9a923ba3-e424-4699-814b-4ab916564720 Jul 24 09:47:39 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:39 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9a923ba3-e424-4699-814b-4ab916564720" returned: 0 in 0.260s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:39 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Lock "cinder-quobyte-9a923ba3-e424-4699-814b-4ab916564720" released by "_copy_volume_from_snapshot" :: held 6.773s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:39 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Lock "cinder-quobyte-551c8b10-aaef-4992-bf3a-7a6e835ed1b2-9a923ba3-e424-4699-814b-4ab916564720" released by "_create_volume_from_snapshot" :: held 6.810s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.829s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-795aad28-3932-460f-bf5c-0971f197c3c4 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.261s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-795aad28-3932-460f-bf5c-0971f197c3c4 tempest-VolumesSnapshotTestJSON-1116693304 None] Creating offline snapshot cc27d9bd-b9bf-40bc-bd33-031b5e06cbff of volume e58afd74-d43a-44d9-b3ca-28d121d76081 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:47:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (addb4c6a-4da4-469a-a218-246f800b923b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a923ba3-e424-4699-814b-4ab916564720', 'volume_size': 1, 'snapshot_id': '551c8b10-aaef-4992-bf3a-7a6e835ed1b2'}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e397d9b-8181-4d24-bd58-550367952431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:39 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c15318-a94d-48a9-8134-63995ed64f94]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-795aad28-3932-460f-bf5c-0971f197c3c4 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:39 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Volume volume-9a923ba3-e424-4699-814b-4ab916564720 (9a923ba3-e424-4699-814b-4ab916564720): created successfully Jul 24 09:47:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e397d9b-8181-4d24-bd58-550367952431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Flow 'volume_create_manager' (017e19f2-f5c3-49a9-a869-1bac65136ff7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:39 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-638f6ffe-72bb-44e2-8698-846c2023d311 tempest-VolumeDependencyTests-150032330 None] Created volume successfully. Jul 24 09:47:39 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081 Jul 24 09:47:39 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:40 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-795aad28-3932-460f-bf5c-0971f197c3c4 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081" returned: 0 in 0.397s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-795aad28-3932-460f-bf5c-0971f197c3c4 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.cc27d9bd-b9bf-40bc-bd33-031b5e06cbff 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:40 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.cc27d9bd-b9bf-40bc-bd33-031b5e06cbff 1G Jul 24 09:47:40 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:40 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-795aad28-3932-460f-bf5c-0971f197c3c4 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.cc27d9bd-b9bf-40bc-bd33-031b5e06cbff 1G" returned: 0 in 0.429s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-795aad28-3932-460f-bf5c-0971f197c3c4 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e58afd74-d43a-44d9-b3ca-28d121d76081 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.cc27d9bd-b9bf-40bc-bd33-031b5e06cbff {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:40 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e58afd74-d43a-44d9-b3ca-28d121d76081 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.cc27d9bd-b9bf-40bc-bd33-031b5e06cbff Jul 24 09:47:40 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] Acquiring lock "cinder-551c8b10-aaef-4992-bf3a-7a6e835ed1b2-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:41 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] Lock "cinder-551c8b10-aaef-4992-bf3a-7a6e835ed1b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:41 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] Acquiring lock "cinder-quobyte-5ef0f08b-3aed-43ac-a00d-664d4a22b42b" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:41 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-795aad28-3932-460f-bf5c-0971f197c3c4 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e58afd74-d43a-44d9-b3ca-28d121d76081 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.cc27d9bd-b9bf-40bc-bd33-031b5e06cbff" returned: 0 in 0.365s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:41 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-795aad28-3932-460f-bf5c-0971f197c3c4 tempest-VolumesSnapshotTestJSON-1116693304 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.cc27d9bd-b9bf-40bc-bd33-031b5e06cbff is being set with open permissions: ugo+rw Jul 24 09:47:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-795aad28-3932-460f-bf5c-0971f197c3c4 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.cc27d9bd-b9bf-40bc-bd33-031b5e06cbff {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:41 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] Lock "cinder-quobyte-5ef0f08b-3aed-43ac-a00d-664d4a22b42b" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:41 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] Acquiring lock "cinder-quobyte-551c8b10-aaef-4992-bf3a-7a6e835ed1b2" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:41 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] Lock "cinder-quobyte-551c8b10-aaef-4992-bf3a-7a6e835ed1b2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:41 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.cc27d9bd-b9bf-40bc-bd33-031b5e06cbff Jul 24 09:47:41 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] Deleting offline snapshot 551c8b10-aaef-4992-bf3a-7a6e835ed1b2 of volume 5ef0f08b-3aed-43ac-a00d-664d4a22b42b {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:47:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] snapshot_file for this snap is: volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:47:41 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7175a617-828b-4d79-808f-cc7ce7a7668e]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:41 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2 Jul 24 09:47:41 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:41 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-795aad28-3932-460f-bf5c-0971f197c3c4 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.cc27d9bd-b9bf-40bc-bd33-031b5e06cbff" returned: 0 in 0.328s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-795aad28-3932-460f-bf5c-0971f197c3c4 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:41 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.info Jul 24 09:47:41 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:41 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2" returned: 0 in 0.456s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:47:41 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[065f7da7-1591-450c-8ab3-4369fa4f56eb]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:41 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-795aad28-3932-460f-bf5c-0971f197c3c4 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.info" returned: 0 in 0.301s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:41 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-795aad28-3932-460f-bf5c-0971f197c3c4 tempest-VolumesSnapshotTestJSON-1116693304 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.info is being set with open permissions: ugo+rw Jul 24 09:47:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-795aad28-3932-460f-bf5c-0971f197c3c4 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:41 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.info Jul 24 09:47:41 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:41 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b Jul 24 09:47:41 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:42 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-795aad28-3932-460f-bf5c-0971f197c3c4 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.info" returned: 0 in 0.320s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-795aad28-3932-460f-bf5c-0971f197c3c4 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.280s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.211s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1097291560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16e06cd986c4322a3a577eba30ea358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:36Z,use_quota=True,user_id='786e00245d894ab3a79e6347dc76a1f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Creating volume ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:42 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:47:42 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b" returned: 0 in 0.489s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:42 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a 1073741824 Jul 24 09:47:42 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:42 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2 Jul 24 09:47:42 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:42 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-795aad28-3932-460f-bf5c-0971f197c3c4 tempest-VolumesSnapshotTestJSON-1116693304 None] Create snapshot completed successfully Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-5d0b4b4e-2d9f-493b-aad8-ef1066285e03 req-3b90d1af-4d84-47cb-a235-d81ef061095a tempest-TestShelveInstance-710840937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:42 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2" returned: 0 in 0.443s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:42 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2 Jul 24 09:47:42 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:42 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a 1073741824" returned: 0 in 0.521s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:42 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a Jul 24 09:47:42 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:42 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b.551c8b10-aaef-4992-bf3a-7a6e835ed1b2" returned: 0 in 0.320s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] Lock "cinder-quobyte-551c8b10-aaef-4992-bf3a-7a6e835ed1b2" released by "_delete_snapshot" :: held 1.859s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] Lock "cinder-quobyte-5ef0f08b-3aed-43ac-a00d-664d4a22b42b" released by "delete_snapshot" :: held 1.895s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:42 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a" returned: 0 in 0.350s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:47:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-5d0b4b4e-2d9f-493b-aad8-ef1066285e03 req-3b90d1af-4d84-47cb-a235-d81ef061095a tempest-TestShelveInstance-710840937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.645s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-5d0b4b4e-2d9f-493b-aad8-ef1066285e03 req-3b90d1af-4d84-47cb-a235-d81ef061095a tempest-TestShelveInstance-710840937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18b7e90-edc7-4d5c-9262-81506bc8d73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb67154-af69-4f73-ae5f-d3caff5b9bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] Created reservations ['5c6ec723-96cc-42fb-b467-9585f75c9b40', '0cc9df75-107e-4554-aa53-b528dab2ddc5', '32919814-b68d-4b32-a184-28f6ae764ca4', 'bb3840ea-c239-408c-8547-4b989a239d3b'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:47:43 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Volume volume-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a (ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a): created successfully Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb67154-af69-4f73-ae5f-d3caff5b9bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Flow 'volume_create_manager' (f6ad0ced-88bd-45c9-a776-831847cf8a42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:43 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-5b134291-8393-4f0b-ad47-72583c444038 tempest-VolumesTransfersV357Test-2003528950 None] Created volume successfully. Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-5d0b4b4e-2d9f-493b-aad8-ef1066285e03 req-3b90d1af-4d84-47cb-a235-d81ef061095a tempest-TestShelveInstance-710840937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-1812af6a-17c6-4573-aa4a-c86d480ad012', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '80c7a6cc-048a-4196-9b94-c6c4082e061d', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:47:43 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] Delete snapshot completed successfully. Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6b4a7881-0e19-4ec7-b1c5-1a621e18b423 tempest-VolumeDependencyTests-150032330 None] Lock "cinder-551c8b10-aaef-4992-bf3a-7a6e835ed1b2-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:43 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-5d0b4b4e-2d9f-493b-aad8-ef1066285e03 req-3b90d1af-4d84-47cb-a235-d81ef061095a tempest-TestShelveInstance-710840937 None] attachment_update completed successfully. Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-cc27d9bd-b9bf-40bc-bd33-031b5e06cbff-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-cc27d9bd-b9bf-40bc-bd33-031b5e06cbff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-quobyte-e58afd74-d43a-44d9-b3ca-28d121d76081" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-e58afd74-d43a-44d9-b3ca-28d121d76081" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-quobyte-cc27d9bd-b9bf-40bc-bd33-031b5e06cbff" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-cc27d9bd-b9bf-40bc-bd33-031b5e06cbff" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] Deleting offline snapshot cc27d9bd-b9bf-40bc-bd33-031b5e06cbff of volume e58afd74-d43a-44d9-b3ca-28d121d76081 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] snapshot_file for this snap is: volume-e58afd74-d43a-44d9-b3ca-28d121d76081.cc27d9bd-b9bf-40bc-bd33-031b5e06cbff {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e850dc-a52c-46db-96a2-9bd304c7b13e]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.cc27d9bd-b9bf-40bc-bd33-031b5e06cbff {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:43 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.cc27d9bd-b9bf-40bc-bd33-031b5e06cbff Jul 24 09:47:43 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6ecfb334-64e5-4192-95f5-33e400c53935 tempest-VolumesTransfersV357Test-214279374 None] Acquiring lock "cinder-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6ecfb334-64e5-4192-95f5-33e400c53935 tempest-VolumesTransfersV357Test-214279374 None] Lock "cinder-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6ecfb334-64e5-4192-95f5-33e400c53935 tempest-VolumesTransfersV357Test-214279374 None] Acquiring lock "cinder-quobyte-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6ecfb334-64e5-4192-95f5-33e400c53935 tempest-VolumesTransfersV357Test-214279374 None] Lock "cinder-quobyte-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[968b190b-d052-40f6-8e43-fa1017a8c91b]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6ecfb334-64e5-4192-95f5-33e400c53935 tempest-VolumesTransfersV357Test-214279374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:43 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a Jul 24 09:47:43 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:44 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.cc27d9bd-b9bf-40bc-bd33-031b5e06cbff" returned: 0 in 0.470s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e58afd74-d43a-44d9-b3ca-28d121d76081(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fe2898-5e59-40cf-8389-059fde67eb3d]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:44 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081 Jul 24 09:47:44 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9104903c-0b98-4464-a81a-c777e2929aa2 tempest-VolumeDependencyTests-150032330 None] Acquiring lock "cinder-5ef0f08b-3aed-43ac-a00d-664d4a22b42b-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9104903c-0b98-4464-a81a-c777e2929aa2 tempest-VolumeDependencyTests-150032330 None] Lock "cinder-5ef0f08b-3aed-43ac-a00d-664d4a22b42b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9104903c-0b98-4464-a81a-c777e2929aa2 tempest-VolumeDependencyTests-150032330 None] Acquiring lock "cinder-quobyte-5ef0f08b-3aed-43ac-a00d-664d4a22b42b" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9104903c-0b98-4464-a81a-c777e2929aa2 tempest-VolumeDependencyTests-150032330 None] Lock "cinder-quobyte-5ef0f08b-3aed-43ac-a00d-664d4a22b42b" acquired by "delete_volume" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[974532a1-99ff-4233-8c00-a5239a7a50cf]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9104903c-0b98-4464-a81a-c777e2929aa2 tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:44 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6ecfb334-64e5-4192-95f5-33e400c53935 tempest-VolumesTransfersV357Test-214279374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a" returned: 0 in 0.555s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6ecfb334-64e5-4192-95f5-33e400c53935 tempest-VolumesTransfersV357Test-214279374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:44 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a Jul 24 09:47:44 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:44 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b Jul 24 09:47:44 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:44 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081" returned: 0 in 0.604s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.cc27d9bd-b9bf-40bc-bd33-031b5e06cbff {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:44 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.cc27d9bd-b9bf-40bc-bd33-031b5e06cbff Jul 24 09:47:44 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:44 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6ecfb334-64e5-4192-95f5-33e400c53935 tempest-VolumesTransfersV357Test-214279374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a" returned: 0 in 0.324s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6ecfb334-64e5-4192-95f5-33e400c53935 tempest-VolumesTransfersV357Test-214279374 None] Lock "cinder-quobyte-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a" released by "delete_volume" :: held 0.932s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-6ecfb334-64e5-4192-95f5-33e400c53935 tempest-VolumesTransfersV357Test-214279374 None] Created reservations ['a0a1fb4d-793b-45f6-9466-31a6978b4f84', 'd7e2eaf5-be7a-44b9-aa21-e629b7cc6e00', '813967c3-8b40-47cd-bfa3-a67f71c33101', 'a0b51b97-6614-49ba-b280-ba4d4ccc4a49'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:47:44 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9104903c-0b98-4464-a81a-c777e2929aa2 tempest-VolumeDependencyTests-150032330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b" returned: 0 in 0.519s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9104903c-0b98-4464-a81a-c777e2929aa2 tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6ecfb334-64e5-4192-95f5-33e400c53935 tempest-VolumesTransfersV357Test-214279374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6ecfb334-64e5-4192-95f5-33e400c53935 tempest-VolumesTransfersV357Test-214279374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6ecfb334-64e5-4192-95f5-33e400c53935 tempest-VolumesTransfersV357Test-214279374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6ecfb334-64e5-4192-95f5-33e400c53935 tempest-VolumesTransfersV357Test-214279374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6ecfb334-64e5-4192-95f5-33e400c53935 tempest-VolumesTransfersV357Test-214279374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6ecfb334-64e5-4192-95f5-33e400c53935 tempest-VolumesTransfersV357Test-214279374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:44 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b Jul 24 09:47:44 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:45 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:47:45 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:45 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.cc27d9bd-b9bf-40bc-bd33-031b5e06cbff" returned: 0 in 0.563s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.cc27d9bd-b9bf-40bc-bd33-031b5e06cbff {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:45 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.cc27d9bd-b9bf-40bc-bd33-031b5e06cbff Jul 24 09:47:45 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:45 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6ecfb334-64e5-4192-95f5-33e400c53935 tempest-VolumesTransfersV357Test-214279374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.414s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:45 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6ecfb334-64e5-4192-95f5-33e400c53935 tempest-VolumesTransfersV357Test-214279374 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:47:45 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-6ecfb334-64e5-4192-95f5-33e400c53935 tempest-VolumesTransfersV357Test-214279374 None] Deleted volume successfully. Jul 24 09:47:45 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9104903c-0b98-4464-a81a-c777e2929aa2 tempest-VolumeDependencyTests-150032330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5ef0f08b-3aed-43ac-a00d-664d4a22b42b" returned: 0 in 0.517s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:45 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9104903c-0b98-4464-a81a-c777e2929aa2 tempest-VolumeDependencyTests-150032330 None] Lock "cinder-quobyte-5ef0f08b-3aed-43ac-a00d-664d4a22b42b" released by "delete_volume" :: held 1.136s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:45 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6ecfb334-64e5-4192-95f5-33e400c53935 tempest-VolumesTransfersV357Test-214279374 None] Lock "cinder-ce20a7f7-3b33-44ce-97fa-3d3e5a147b6a-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:45 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-9104903c-0b98-4464-a81a-c777e2929aa2 tempest-VolumeDependencyTests-150032330 None] Created reservations ['3effd23e-f412-4d79-be82-e4e90b084713', '55fb38e8-ddfe-4b6b-8ff5-03cf56c10709', 'e85bfd3c-a247-4fc9-8a24-ef08c64e68b4', '25c9edf3-d45d-45f8-8a4c-7f09592e6ca8'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:47:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9104903c-0b98-4464-a81a-c777e2929aa2 tempest-VolumeDependencyTests-150032330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9104903c-0b98-4464-a81a-c777e2929aa2 tempest-VolumeDependencyTests-150032330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9104903c-0b98-4464-a81a-c777e2929aa2 tempest-VolumeDependencyTests-150032330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9104903c-0b98-4464-a81a-c777e2929aa2 tempest-VolumeDependencyTests-150032330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9104903c-0b98-4464-a81a-c777e2929aa2 tempest-VolumeDependencyTests-150032330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9104903c-0b98-4464-a81a-c777e2929aa2 tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:45 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:47:45 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:45 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081.cc27d9bd-b9bf-40bc-bd33-031b5e06cbff" returned: 0 in 0.703s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:45 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-cc27d9bd-b9bf-40bc-bd33-031b5e06cbff" released by "_delete_snapshot" :: held 2.512s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-e58afd74-d43a-44d9-b3ca-28d121d76081" released by "delete_snapshot" :: held 2.543s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:46 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] Created reservations ['ccb84f72-5a7a-41f2-873d-9948096a8e2a', '42bef71d-9b39-45b3-80a5-977365bf9fd1', '79e8c837-9f95-49b6-9d71-fcf45d029a34', '0ec23ddd-4a8e-4072-bd12-aebd2126f8ac'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:47:46 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] Delete snapshot completed successfully. Jul 24 09:47:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-bbd09d97-4cda-4290-b7c5-9337d270986b tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-cc27d9bd-b9bf-40bc-bd33-031b5e06cbff-delete_snapshot" released by "delete_snapshot" :: held 2.975s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:46 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9104903c-0b98-4464-a81a-c777e2929aa2 tempest-VolumeDependencyTests-150032330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.569s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:46 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-9104903c-0b98-4464-a81a-c777e2929aa2 tempest-VolumeDependencyTests-150032330 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:47:46 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-9104903c-0b98-4464-a81a-c777e2929aa2 tempest-VolumeDependencyTests-150032330 None] Deleted volume successfully. Jul 24 09:47:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9104903c-0b98-4464-a81a-c777e2929aa2 tempest-VolumeDependencyTests-150032330 None] Lock "cinder-5ef0f08b-3aed-43ac-a00d-664d4a22b42b-delete_volume" released by "delete_volume" :: held 2.133s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-03e40bcb-9847-42fe-b60a-88c26d48f0d4 tempest-VolumeDependencyTests-150032330 None] Acquiring lock "cinder-9a923ba3-e424-4699-814b-4ab916564720-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-03e40bcb-9847-42fe-b60a-88c26d48f0d4 tempest-VolumeDependencyTests-150032330 None] Lock "cinder-9a923ba3-e424-4699-814b-4ab916564720-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-03e40bcb-9847-42fe-b60a-88c26d48f0d4 tempest-VolumeDependencyTests-150032330 None] Acquiring lock "cinder-quobyte-9a923ba3-e424-4699-814b-4ab916564720" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-03e40bcb-9847-42fe-b60a-88c26d48f0d4 tempest-VolumeDependencyTests-150032330 None] Lock "cinder-quobyte-9a923ba3-e424-4699-814b-4ab916564720" acquired by "delete_volume" :: waited 0.024s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:46 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e649d7df-98ec-4678-b4e1-b108085af0e4]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-03e40bcb-9847-42fe-b60a-88c26d48f0d4 tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9a923ba3-e424-4699-814b-4ab916564720 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:46 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9a923ba3-e424-4699-814b-4ab916564720 Jul 24 09:47:46 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:47 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-03e40bcb-9847-42fe-b60a-88c26d48f0d4 tempest-VolumeDependencyTests-150032330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9a923ba3-e424-4699-814b-4ab916564720" returned: 0 in 0.503s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-03e40bcb-9847-42fe-b60a-88c26d48f0d4 tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9a923ba3-e424-4699-814b-4ab916564720 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:47 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9a923ba3-e424-4699-814b-4ab916564720 Jul 24 09:47:47 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Flow 'volume_create_manager' (f437ada2-7847-4044-886f-6837ce26e56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cb16da-ac74-4335-9ef2-51c2cede3f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cb16da-ac74-4335-9ef2-51c2cede3f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1169592293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae5940a-bd04-4b1b-95ec-eff0e013ad86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3457802bc2b34831afd7aade300294c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:47Z,use_quota=True,user_id='a72de313c231466c875ce495f3e132bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c9c9d81-e0c0-42a0-aca9-98afbc5c68aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c9c9d81-e0c0-42a0-aca9-98afbc5c68aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06642c9-1a7d-48f0-a359-fc08b244188b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06642c9-1a7d-48f0-a359-fc08b244188b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ae5940a-bd04-4b1b-95ec-eff0e013ad86', 'volume_name': 'volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141c4362-a263-4a96-9644-b32930275729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141c4362-a263-4a96-9644-b32930275729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac02ca6-e9c4-47e8-b17c-304a80991996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:47 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Volume 2ae5940a-bd04-4b1b-95ec-eff0e013ad86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86', 'volume_size': 1} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1169592293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae5940a-bd04-4b1b-95ec-eff0e013ad86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3457802bc2b34831afd7aade300294c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:47Z,use_quota=True,user_id='a72de313c231466c875ce495f3e132bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Creating volume 2ae5940a-bd04-4b1b-95ec-eff0e013ad86 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:47:47 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:47 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-03e40bcb-9847-42fe-b60a-88c26d48f0d4 tempest-VolumeDependencyTests-150032330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9a923ba3-e424-4699-814b-4ab916564720" returned: 0 in 0.335s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:47 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 1073741824 Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-03e40bcb-9847-42fe-b60a-88c26d48f0d4 tempest-VolumeDependencyTests-150032330 None] Lock "cinder-quobyte-9a923ba3-e424-4699-814b-4ab916564720" released by "delete_volume" :: held 0.887s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:47 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-03e40bcb-9847-42fe-b60a-88c26d48f0d4 tempest-VolumeDependencyTests-150032330 None] Created reservations ['4c2178c0-c3ea-42be-be9e-a8640a0bceaf', 'fc923bcf-4257-4ef2-b28b-9ec7bc345c99', 'c8405fdd-89c4-44fe-a4ba-d176767bcaa0', 'cf195d78-a24b-4dc7-a43c-863ea5bac5f2'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-03e40bcb-9847-42fe-b60a-88c26d48f0d4 tempest-VolumeDependencyTests-150032330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-03e40bcb-9847-42fe-b60a-88c26d48f0d4 tempest-VolumeDependencyTests-150032330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-03e40bcb-9847-42fe-b60a-88c26d48f0d4 tempest-VolumeDependencyTests-150032330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-03e40bcb-9847-42fe-b60a-88c26d48f0d4 tempest-VolumeDependencyTests-150032330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-03e40bcb-9847-42fe-b60a-88c26d48f0d4 tempest-VolumeDependencyTests-150032330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-03e40bcb-9847-42fe-b60a-88c26d48f0d4 tempest-VolumeDependencyTests-150032330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:47 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:47:47 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:48 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-03e40bcb-9847-42fe-b60a-88c26d48f0d4 tempest-VolumeDependencyTests-150032330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.394s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:48 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-03e40bcb-9847-42fe-b60a-88c26d48f0d4 tempest-VolumeDependencyTests-150032330 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:47:48 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-03e40bcb-9847-42fe-b60a-88c26d48f0d4 tempest-VolumeDependencyTests-150032330 None] Deleted volume successfully. Jul 24 09:47:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-03e40bcb-9847-42fe-b60a-88c26d48f0d4 tempest-VolumeDependencyTests-150032330 None] Lock "cinder-9a923ba3-e424-4699-814b-4ab916564720-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:47:48 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 1073741824" returned: 0 in 0.747s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:48 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 Jul 24 09:47:48 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:48 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86" returned: 0 in 0.461s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:48 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:47:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac02ca6-e9c4-47e8-b17c-304a80991996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6963a375-bbb9-4b5d-9724-2f57c814e508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:49 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Volume volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 (2ae5940a-bd04-4b1b-95ec-eff0e013ad86): created successfully Jul 24 09:47:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6963a375-bbb9-4b5d-9724-2f57c814e508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:49 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Flow 'volume_create_manager' (f437ada2-7847-4044-886f-6837ce26e56e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:49 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-ec5a327b-b7a6-484a-8726-e70695f9fcb1 tempest-VolumesSnapshotTestJSON-1116693304 None] Created volume successfully. Jul 24 09:47:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-42237d3c-caaf-4039-8df7-0277b4ac733e tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-42237d3c-caaf-4039-8df7-0277b4ac733e tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-42237d3c-caaf-4039-8df7-0277b4ac733e tempest-VolumesSnapshotTestJSON-1116693304 None] Creating offline snapshot ef379548-b9fe-473b-abd8-27d816997880 of volume 2ae5940a-bd04-4b1b-95ec-eff0e013ad86 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:47:50 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e370f97a-a95e-4f3e-9bf6-53dc00ce9a82]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-42237d3c-caaf-4039-8df7-0277b4ac733e tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:50 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 Jul 24 09:47:50 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:50 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-42237d3c-caaf-4039-8df7-0277b4ac733e tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86" returned: 0 in 0.743s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-42237d3c-caaf-4039-8df7-0277b4ac733e tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:50 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880 1G Jul 24 09:47:50 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:51 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-42237d3c-caaf-4039-8df7-0277b4ac733e tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880 1G" returned: 0 in 0.809s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-42237d3c-caaf-4039-8df7-0277b4ac733e tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:51 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880 Jul 24 09:47:51 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:52 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-42237d3c-caaf-4039-8df7-0277b4ac733e tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880" returned: 0 in 0.615s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:52 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-42237d3c-caaf-4039-8df7-0277b4ac733e tempest-VolumesSnapshotTestJSON-1116693304 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880 is being set with open permissions: ugo+rw Jul 24 09:47:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-42237d3c-caaf-4039-8df7-0277b4ac733e tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:52 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880 Jul 24 09:47:52 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:52 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-42237d3c-caaf-4039-8df7-0277b4ac733e tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880" returned: 0 in 0.451s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-42237d3c-caaf-4039-8df7-0277b4ac733e tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:52 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.info Jul 24 09:47:52 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:53 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-42237d3c-caaf-4039-8df7-0277b4ac733e tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.info" returned: 0 in 0.368s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:53 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-42237d3c-caaf-4039-8df7-0277b4ac733e tempest-VolumesSnapshotTestJSON-1116693304 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.info is being set with open permissions: ugo+rw Jul 24 09:47:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-42237d3c-caaf-4039-8df7-0277b4ac733e tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:53 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.info Jul 24 09:47:53 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:53 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-42237d3c-caaf-4039-8df7-0277b4ac733e tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.info" returned: 0 in 0.447s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-42237d3c-caaf-4039-8df7-0277b4ac733e tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.617s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:53 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-42237d3c-caaf-4039-8df7-0277b4ac733e tempest-VolumesSnapshotTestJSON-1116693304 None] Create snapshot completed successfully Jul 24 09:47:53 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:47:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Flow 'volume_create_manager' (bf71dc0e-a6b9-4ea2-998c-e6c7d9bd6d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fffed90-88a5-4cd7-a84a-3f9beff44029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fffed90-88a5-4cd7-a84a-3f9beff44029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6757058-85c9-40bd-acc4-62de61980b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba734ffb1d04910b81790c3f71044ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:54Z,use_quota=True,user_id='a6d9892ec6c1490a95ade2e9491e4130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e867e8-108b-4776-a2af-526572584588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e867e8-108b-4776-a2af-526572584588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68539736-9b6d-40e1-bc2e-98883ae25f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68539736-9b6d-40e1-bc2e-98883ae25f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6757058-85c9-40bd-acc4-62de61980b90', 'volume_name': 'volume-b6757058-85c9-40bd-acc4-62de61980b90', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b3daed-458d-4dfc-87f1-f7e7c6515cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b3daed-458d-4dfc-87f1-f7e7c6515cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53cfee16-a52a-42ce-948e-f10b9cde751e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:53 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Volume b6757058-85c9-40bd-acc4-62de61980b90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6757058-85c9-40bd-acc4-62de61980b90', 'volume_size': 1} Jul 24 09:47:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6757058-85c9-40bd-acc4-62de61980b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba734ffb1d04910b81790c3f71044ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:54Z,use_quota=True,user_id='a6d9892ec6c1490a95ade2e9491e4130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:47:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Creating volume b6757058-85c9-40bd-acc4-62de61980b90 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:47:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:47:54 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:47:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6757058-85c9-40bd-acc4-62de61980b90 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:54 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6757058-85c9-40bd-acc4-62de61980b90 1073741824 Jul 24 09:47:54 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:54 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6757058-85c9-40bd-acc4-62de61980b90 1073741824" returned: 0 in 0.700s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:54 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:47:54 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Flow 'volume_create_manager' (48789bfc-7a2e-465d-a93f-5171c6ff1969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:54 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659cef8c-6f3d-4bda-b959-2b994bd72a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:54 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659cef8c-6f3d-4bda-b959-2b994bd72a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-753677820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303f07f0-0355-4253-b3b5-69a0738ed3b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a7be9c6762409f9b181b71a9d98cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:55Z,use_quota=True,user_id='aa9dba44a73545da9e547527ae78bea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:54 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa8a79a-c202-4d80-b137-8c160061729b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:54 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa8a79a-c202-4d80-b137-8c160061729b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:54 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca2a7af5-a4fc-4e08-94eb-d4f4fc95097a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca2a7af5-a4fc-4e08-94eb-d4f4fc95097a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '303f07f0-0355-4253-b3b5-69a0738ed3b8', 'volume_name': 'volume-303f07f0-0355-4253-b3b5-69a0738ed3b8', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8245a82-5a67-4e87-8e03-a7c1b44cb21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8245a82-5a67-4e87-8e03-a7c1b44cb21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13771314-07ea-48e7-a1ea-928c66074cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:55 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Volume 303f07f0-0355-4253-b3b5-69a0738ed3b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-303f07f0-0355-4253-b3b5-69a0738ed3b8', 'volume_size': 1} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6757058-85c9-40bd-acc4-62de61980b90 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:55 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6757058-85c9-40bd-acc4-62de61980b90 Jul 24 09:47:55 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Flow 'volume_create_manager' (a54762ae-dfd5-4942-843b-4c91fa791436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0766b3b-9ea2-4bd9-85b3-5a1c74911914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0766b3b-9ea2-4bd9-85b3-5a1c74911914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-889402404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8cf0245-9438-4c68-b1b0-9fafae019bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3457802bc2b34831afd7aade300294c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ef379548-b9fe-473b-abd8-27d816997880,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:55Z,use_quota=True,user_id='a72de313c231466c875ce495f3e132bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797d769f-9308-472d-99eb-5d53eedbbc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797d769f-9308-472d-99eb-5d53eedbbc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a10b1d4-edbc-49fb-8710-138a3ec6922e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a10b1d4-edbc-49fb-8710-138a3ec6922e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b8cf0245-9438-4c68-b1b0-9fafae019bd2', 'volume_name': 'volume-b8cf0245-9438-4c68-b1b0-9fafae019bd2', 'volume_size': 2, 'snapshot_id': 'ef379548-b9fe-473b-abd8-27d816997880'}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a6c3bf-688b-4f64-851c-e9ebe0d7e908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a6c3bf-688b-4f64-851c-e9ebe0d7e908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8054b53-ca29-4895-ab55-e6115eea9eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:55 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Volume b8cf0245-9438-4c68-b1b0-9fafae019bd2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b8cf0245-9438-4c68-b1b0-9fafae019bd2', 'volume_size': 2, 'snapshot_id': 'ef379548-b9fe-473b-abd8-27d816997880'} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:55 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6757058-85c9-40bd-acc4-62de61980b90" returned: 0 in 0.304s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.315s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-753677820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303f07f0-0355-4253-b3b5-69a0738ed3b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a7be9c6762409f9b181b71a9d98cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:55Z,use_quota=True,user_id='aa9dba44a73545da9e547527ae78bea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Creating volume 303f07f0-0355-4253-b3b5-69a0738ed3b8 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:47:55 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53cfee16-a52a-42ce-948e-f10b9cde751e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6757058-85c9-40bd-acc4-62de61980b90', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6563993-c932-41b2-a2a7-b07dcf11f495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:55 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 1073741824 Jul 24 09:47:55 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:55 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Volume volume-b6757058-85c9-40bd-acc4-62de61980b90 (b6757058-85c9-40bd-acc4-62de61980b90): created successfully Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6563993-c932-41b2-a2a7-b07dcf11f495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Flow 'volume_create_manager' (bf71dc0e-a6b9-4ea2-998c-e6c7d9bd6d58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:55 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-6239b944-004e-4517-a67a-8b3b526d7a78 tempest-CinderUnicodeTest-954483509 None] Created volume successfully. Jul 24 09:47:55 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 1073741824" returned: 0 in 0.488s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:55 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 Jul 24 09:47:55 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:56 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8" returned: 0 in 0.283s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.928s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-quobyte-ef379548-b9fe-473b-abd8-27d816997880-b8cf0245-9438-4c68-b1b0-9fafae019bd2" by "_create_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13771314-07ea-48e7-a1ea-928c66074cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-303f07f0-0355-4253-b3b5-69a0738ed3b8', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33481dd7-48d6-4693-b02f-0d3ada913034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-ef379548-b9fe-473b-abd8-27d816997880-b8cf0245-9438-4c68-b1b0-9fafae019bd2" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Creating volume b8cf0245-9438-4c68-b1b0-9fafae019bd2 from snapshot ef379548-b9fe-473b-abd8-27d816997880 {{(pid=88488) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-quobyte-b8cf0245-9438-4c68-b1b0-9fafae019bd2" by "_copy_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:47:56 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Volume volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 (303f07f0-0355-4253-b3b5-69a0738ed3b8): created successfully Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33481dd7-48d6-4693-b02f-0d3ada913034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Flow 'volume_create_manager' (48789bfc-7a2e-465d-a93f-5171c6ff1969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-b8cf0245-9438-4c68-b1b0-9fafae019bd2" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] snapshot: ef379548-b9fe-473b-abd8-27d816997880, volume: b8cf0245-9438-4c68-b1b0-9fafae019bd2, {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 09:47:56 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-002f627d-987c-4b23-961b-fd8d2b712dab tempest-VolumesCloneTest-2010850886 None] Created volume successfully. Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[94426879-8712-4eaa-836c-4d108ec7a0ac]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:56 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880 Jul 24 09:47:56 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Flow 'volume_create_manager' (d12b7468-2004-48c7-ab7f-4dfa8a2d8450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277b6c5c-fec4-4b33-878c-e52399bdf53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277b6c5c-fec4-4b33-878c-e52399bdf53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1497283694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e9eedb-6eea-46f9-86fc-39c427812266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba734ffb1d04910b81790c3f71044ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:57Z,use_quota=True,user_id='a6d9892ec6c1490a95ade2e9491e4130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8a382a-b852-41dc-b25d-f55903e5bb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8a382a-b852-41dc-b25d-f55903e5bb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c269a90-2ede-4a2e-97dc-435317a79c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c269a90-2ede-4a2e-97dc-435317a79c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03e9eedb-6eea-46f9-86fc-39c427812266', 'volume_name': 'volume-03e9eedb-6eea-46f9-86fc-39c427812266', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0059ed34-ca68-4006-b304-35a758cd3710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0059ed34-ca68-4006-b304-35a758cd3710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a4bdc8-f001-4078-835a-ac5a041edac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:56 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Volume 03e9eedb-6eea-46f9-86fc-39c427812266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03e9eedb-6eea-46f9-86fc-39c427812266', 'volume_size': 1} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:47:56 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880" returned: 0 in 0.484s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Creating direct copy from snapshot {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6b9135-ed63-4203-9a1e-29b1e55c49fb]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:47:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:56 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 Jul 24 09:47:56 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:57 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Jul 24 09:47:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86" returned: 0 in 0.441s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:47:57 devstack cinder-volume[88488]: DEBUG cinder.utils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Path /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b8cf0245-9438-4c68-b1b0-9fafae019bd2 not found in is_blk_device check {{(pid=88488) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 09:47:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b8cf0245-9438-4c68-b1b0-9fafae019bd2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:47:57 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:47:57 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b8cf0245-9438-4c68-b1b0-9fafae019bd2 Jul 24 09:47:57 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:47:57 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Flow 'volume_create_manager' (d1fbb666-be3f-4cf6-995f-da4c9e625909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:47:57 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddade956-f9d5-4a91-acdb-a460949ad000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:57 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddade956-f9d5-4a91-acdb-a460949ad000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1755149379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f29e10d-8507-4fcc-8202-f39d00a1ce62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a7be9c6762409f9b181b71a9d98cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=303f07f0-0355-4253-b3b5-69a0738ed3b8,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:57Z,use_quota=True,user_id='aa9dba44a73545da9e547527ae78bea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:57 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c71a69-aaae-4a62-9f78-cff7c62d3efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:57 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c71a69-aaae-4a62-9f78-cff7c62d3efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:57 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba34dbf5-4c8d-4cfe-a566-382bed9dfd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:57 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba34dbf5-4c8d-4cfe-a566-382bed9dfd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7f29e10d-8507-4fcc-8202-f39d00a1ce62', 'volume_name': 'volume-7f29e10d-8507-4fcc-8202-f39d00a1ce62', 'volume_size': 2, 'source_volid': '303f07f0-0355-4253-b3b5-69a0738ed3b8', 'source_volstatus': 'available'}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:57 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fffe72be-d4e8-43cc-80c1-256a78d7e601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:57 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fffe72be-d4e8-43cc-80c1-256a78d7e601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:47:57 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c5b209-a368-4986-8f75-7d6b812d6c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:47:57 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Volume 7f29e10d-8507-4fcc-8202-f39d00a1ce62: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7f29e10d-8507-4fcc-8202-f39d00a1ce62', 'volume_size': 2, 'source_volid': '303f07f0-0355-4253-b3b5-69a0738ed3b8', 'source_volstatus': 'available'} Jul 24 09:47:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:02 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b8cf0245-9438-4c68-b1b0-9fafae019bd2" returned: 0 in 5.541s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:02 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bf115a-b6a6-40c0-b4ec-ec09778a4b52]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:02 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 Jul 24 09:48:02 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:03 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86" returned: 0 in 0.547s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b8cf0245-9438-4c68-b1b0-9fafae019bd2 {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:48:03 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Converted 1024.00 MB image at 184.78 MB/s Jul 24 09:48:03 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b8cf0245-9438-4c68-b1b0-9fafae019bd2 is being set with open permissions: ugo+rw Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b8cf0245-9438-4c68-b1b0-9fafae019bd2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:03 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b8cf0245-9438-4c68-b1b0-9fafae019bd2 Jul 24 09:48:03 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:03 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b8cf0245-9438-4c68-b1b0-9fafae019bd2" returned: 0 in 0.238s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-b8cf0245-9438-4c68-b1b0-9fafae019bd2" released by "_copy_volume_from_snapshot" :: held 7.365s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-ef379548-b9fe-473b-abd8-27d816997880-b8cf0245-9438-4c68-b1b0-9fafae019bd2" released by "_create_volume_from_snapshot" :: held 7.413s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.451s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.879s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:47:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1497283694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e9eedb-6eea-46f9-86fc-39c427812266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba734ffb1d04910b81790c3f71044ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:47:57Z,use_quota=True,user_id='a6d9892ec6c1490a95ade2e9491e4130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Creating volume 03e9eedb-6eea-46f9-86fc-39c427812266 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:48:03 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:03 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266 1073741824 Jul 24 09:48:03 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8054b53-ca29-4895-ab55-e6115eea9eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8cf0245-9438-4c68-b1b0-9fafae019bd2', 'volume_size': 2, 'snapshot_id': 'ef379548-b9fe-473b-abd8-27d816997880'}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b5d0b4-b88e-42c9-af61-b4793ade37bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:03 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Volume volume-b8cf0245-9438-4c68-b1b0-9fafae019bd2 (b8cf0245-9438-4c68-b1b0-9fafae019bd2): created successfully Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b5d0b4-b88e-42c9-af61-b4793ade37bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:03 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Flow 'volume_create_manager' (a54762ae-dfd5-4942-843b-4c91fa791436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:48:03 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-762981df-d1dc-4882-b850-8562a0f04f3b tempest-VolumesSnapshotTestJSON-1116693304 None] Created volume successfully. Jul 24 09:48:04 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266 1073741824" returned: 0 in 0.481s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ac1604b7-0fcb-4a48-9eb5-820cb9307b43 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-b8cf0245-9438-4c68-b1b0-9fafae019bd2-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ac1604b7-0fcb-4a48-9eb5-820cb9307b43 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-b8cf0245-9438-4c68-b1b0-9fafae019bd2-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:04 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266 Jul 24 09:48:04 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ac1604b7-0fcb-4a48-9eb5-820cb9307b43 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-quobyte-b8cf0245-9438-4c68-b1b0-9fafae019bd2" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ac1604b7-0fcb-4a48-9eb5-820cb9307b43 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-b8cf0245-9438-4c68-b1b0-9fafae019bd2" acquired by "delete_volume" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d239a3-a4be-4527-96d3-004bdde5a7ad]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ac1604b7-0fcb-4a48-9eb5-820cb9307b43 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b8cf0245-9438-4c68-b1b0-9fafae019bd2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:04 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b8cf0245-9438-4c68-b1b0-9fafae019bd2 Jul 24 09:48:04 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:04 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266" returned: 0 in 0.324s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.099s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:04 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Cloning volume 303f07f0-0355-4253-b3b5-69a0738ed3b8 to volume 7f29e10d-8507-4fcc-8202-f39d00a1ce62 Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a4bdc8-f001-4078-835a-ac5a041edac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e9eedb-6eea-46f9-86fc-39c427812266', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e19a87c-b1ac-4ba0-a48f-e54ca21c5a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Creating offline snapshot 042de5b6-4711-47a4-9cb2-655de30af19d of volume 303f07f0-0355-4253-b3b5-69a0738ed3b8 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:48:04 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Volume volume-03e9eedb-6eea-46f9-86fc-39c427812266 (03e9eedb-6eea-46f9-86fc-39c427812266): created successfully Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e19a87c-b1ac-4ba0-a48f-e54ca21c5a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Flow 'volume_create_manager' (d12b7468-2004-48c7-ab7f-4dfa8a2d8450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:48:04 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-a5f99e0c-8a52-4c86-b0b8-2a0becf49020 tempest-CinderUnicodeTest-954483509 None] Created volume successfully. Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ead42e-149b-42c8-98e4-55ee3d42f122]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:04 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ac1604b7-0fcb-4a48-9eb5-820cb9307b43 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b8cf0245-9438-4c68-b1b0-9fafae019bd2" returned: 0 in 0.474s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ac1604b7-0fcb-4a48-9eb5-820cb9307b43 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b8cf0245-9438-4c68-b1b0-9fafae019bd2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:04 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 Jul 24 09:48:04 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:04 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b8cf0245-9438-4c68-b1b0-9fafae019bd2 Jul 24 09:48:04 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:05 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ac1604b7-0fcb-4a48-9eb5-820cb9307b43 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b8cf0245-9438-4c68-b1b0-9fafae019bd2" returned: 0 in 0.263s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ac1604b7-0fcb-4a48-9eb5-820cb9307b43 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-b8cf0245-9438-4c68-b1b0-9fafae019bd2" released by "delete_volume" :: held 0.791s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:05 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8" returned: 0 in 0.492s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:05 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d 1G Jul 24 09:48:05 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-ac1604b7-0fcb-4a48-9eb5-820cb9307b43 tempest-VolumesSnapshotTestJSON-1116693304 None] Created reservations ['6aae1e79-b3ee-459c-a56c-f5764d126293', '712ef4c0-1189-40e9-bbd5-4e0765ce9a65', '2e51eb4d-a682-4552-92f1-6c20ce20792e', 'e1a82aae-2956-4cdb-815f-e05655f434ac'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ac1604b7-0fcb-4a48-9eb5-820cb9307b43 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ac1604b7-0fcb-4a48-9eb5-820cb9307b43 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ac1604b7-0fcb-4a48-9eb5-820cb9307b43 tempest-VolumesSnapshotTestJSON-1116693304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ac1604b7-0fcb-4a48-9eb5-820cb9307b43 tempest-VolumesSnapshotTestJSON-1116693304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ac1604b7-0fcb-4a48-9eb5-820cb9307b43 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ac1604b7-0fcb-4a48-9eb5-820cb9307b43 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:05 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:48:05 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-ef379548-b9fe-473b-abd8-27d816997880-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-ef379548-b9fe-473b-abd8-27d816997880-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-quobyte-2ae5940a-bd04-4b1b-95ec-eff0e013ad86" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:05 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-2ae5940a-bd04-4b1b-95ec-eff0e013ad86" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-quobyte-ef379548-b9fe-473b-abd8-27d816997880" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ac1604b7-0fcb-4a48-9eb5-820cb9307b43 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.300s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-ac1604b7-0fcb-4a48-9eb5-820cb9307b43 tempest-VolumesSnapshotTestJSON-1116693304 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:48:05 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-ac1604b7-0fcb-4a48-9eb5-820cb9307b43 tempest-VolumesSnapshotTestJSON-1116693304 None] Deleted volume successfully. Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-ef379548-b9fe-473b-abd8-27d816997880" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] Deleting offline snapshot ef379548-b9fe-473b-abd8-27d816997880 of volume 2ae5940a-bd04-4b1b-95ec-eff0e013ad86 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] snapshot_file for this snap is: volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d4fe23-38b7-4469-98f3-5210508e3fc2]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ac1604b7-0fcb-4a48-9eb5-820cb9307b43 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-b8cf0245-9438-4c68-b1b0-9fafae019bd2-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:05 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d 1G" returned: 0 in 0.604s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:05 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880 Jul 24 09:48:05 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:05 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d Jul 24 09:48:05 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cdb10cf1-7fe4-453f-93e6-341f6f71aab1 tempest-CinderUnicodeTest-954483509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:06 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880" returned: 0 in 0.430s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:48:06 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d" returned: 0 in 0.350s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:06 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d is being set with open permissions: ugo+rw Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa90506-817f-4281-87ea-9c5ca71e6cb0]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:06 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d Jul 24 09:48:06 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:06 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 Jul 24 09:48:06 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:06 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d" returned: 0 in 0.262s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:06 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.info Jul 24 09:48:06 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:06 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86" returned: 0 in 0.384s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:06 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880 Jul 24 09:48:06 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:06 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.info" returned: 0 in 0.261s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:06 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.info is being set with open permissions: ugo+rw Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:06 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.info Jul 24 09:48:06 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:06 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880" returned: 0 in 0.337s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:06 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880 Jul 24 09:48:06 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:06 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.info" returned: 0 in 0.261s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Acquiring lock "cinder-quobyte-7f29e10d-8507-4fcc-8202-f39d00a1ce62" by "_copy_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Lock "cinder-quobyte-7f29e10d-8507-4fcc-8202-f39d00a1ce62" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] snapshot: 042de5b6-4711-47a4-9cb2-655de30af19d, volume: 7f29e10d-8507-4fcc-8202-f39d00a1ce62, {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[70671342-3711-4975-817e-4dec1a42a6bc]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:07 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d Jul 24 09:48:07 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:07 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86.ef379548-b9fe-473b-abd8-27d816997880" returned: 0 in 0.250s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-ef379548-b9fe-473b-abd8-27d816997880" released by "_delete_snapshot" :: held 1.534s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-2ae5940a-bd04-4b1b-95ec-eff0e013ad86" released by "delete_snapshot" :: held 1.570s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:07 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] Created reservations ['90a8589c-8ab9-432b-8c26-0e53d317ca6e', '2a0e0537-842f-44cc-a3fd-2d634d376e5f', '7f3fac88-774a-43ab-9f33-c7e7d4659675', '31e61fee-4182-4808-a1c4-84287b46b47f'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:48:07 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] Delete snapshot completed successfully. Jul 24 09:48:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d41237b4-90ea-4a6c-a685-568ef78d4ceb tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-ef379548-b9fe-473b-abd8-27d816997880-delete_snapshot" released by "delete_snapshot" :: held 1.739s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:07 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d" returned: 0 in 0.367s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-303f07f0-0355-4253-b3b5-69a0738ed3b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:48:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 09:48:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Creating direct copy from snapshot {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 09:48:07 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[050fb44c-6800-4cd5-b32b-6cf4846d7b10]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:07 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 Jul 24 09:48:07 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:07 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-70dd5669-7325-4346-9ab4-552a376171a1 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-2ae5940a-bd04-4b1b-95ec-eff0e013ad86-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8" returned: 0 in 0.358s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:07 devstack cinder-volume[88488]: DEBUG cinder.utils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Path /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7f29e10d-8507-4fcc-8202-f39d00a1ce62 not found in is_blk_device check {{(pid=88488) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 09:48:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7f29e10d-8507-4fcc-8202-f39d00a1ce62 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-70dd5669-7325-4346-9ab4-552a376171a1 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-2ae5940a-bd04-4b1b-95ec-eff0e013ad86-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:07 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7f29e10d-8507-4fcc-8202-f39d00a1ce62 Jul 24 09:48:07 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-70dd5669-7325-4346-9ab4-552a376171a1 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-quobyte-2ae5940a-bd04-4b1b-95ec-eff0e013ad86" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-70dd5669-7325-4346-9ab4-552a376171a1 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-2ae5940a-bd04-4b1b-95ec-eff0e013ad86" acquired by "delete_volume" :: waited 0.014s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:07 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5765a7-8eea-4f6f-828d-3f9d273909ce]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-70dd5669-7325-4346-9ab4-552a376171a1 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:07 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 Jul 24 09:48:07 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:08 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-70dd5669-7325-4346-9ab4-552a376171a1 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86" returned: 0 in 0.521s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-70dd5669-7325-4346-9ab4-552a376171a1 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:08 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86 Jul 24 09:48:08 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:08 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-70dd5669-7325-4346-9ab4-552a376171a1 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2ae5940a-bd04-4b1b-95ec-eff0e013ad86" returned: 0 in 0.352s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-70dd5669-7325-4346-9ab4-552a376171a1 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-2ae5940a-bd04-4b1b-95ec-eff0e013ad86" released by "delete_volume" :: held 0.958s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:08 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-70dd5669-7325-4346-9ab4-552a376171a1 tempest-VolumesSnapshotTestJSON-1116693304 None] Created reservations ['85e450fe-0f76-4ef2-94f4-5f68aaa212ef', '79ce7b6c-fc68-46cd-8ca8-7e7929b6057f', '0d22bac3-a8f9-4103-a806-8013a0a0b977', 'f854c79f-a66d-4ea5-ae64-75d3c12b1595'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:48:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-70dd5669-7325-4346-9ab4-552a376171a1 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-70dd5669-7325-4346-9ab4-552a376171a1 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-70dd5669-7325-4346-9ab4-552a376171a1 tempest-VolumesSnapshotTestJSON-1116693304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-70dd5669-7325-4346-9ab4-552a376171a1 tempest-VolumesSnapshotTestJSON-1116693304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-70dd5669-7325-4346-9ab4-552a376171a1 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-70dd5669-7325-4346-9ab4-552a376171a1 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:09 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:48:09 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:09 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-70dd5669-7325-4346-9ab4-552a376171a1 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.393s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:09 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-70dd5669-7325-4346-9ab4-552a376171a1 tempest-VolumesSnapshotTestJSON-1116693304 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:48:09 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-70dd5669-7325-4346-9ab4-552a376171a1 tempest-VolumesSnapshotTestJSON-1116693304 None] Deleted volume successfully. Jul 24 09:48:09 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-70dd5669-7325-4346-9ab4-552a376171a1 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-2ae5940a-bd04-4b1b-95ec-eff0e013ad86-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:11 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:48:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Flow 'volume_create_manager' (0c629cad-ad10-4ec1-8b18-403cf2f9a83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:48:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11237ea-7490-44ff-a235-22f59ea41c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11237ea-7490-44ff-a235-22f59ea41c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-5872346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ef1f51-3b90-4c25-9d8a-ba77e9c182ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3457802bc2b34831afd7aade300294c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:48:11Z,use_quota=True,user_id='a72de313c231466c875ce495f3e132bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1838549-f150-49d2-ac62-acca0a7b3b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1838549-f150-49d2-ac62-acca0a7b3b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ed2df4-51e5-4974-a8e7-0c4b0cb66f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ed2df4-51e5-4974-a8e7-0c4b0cb66f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10ef1f51-3b90-4c25-9d8a-ba77e9c182ec', 'volume_name': 'volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b2016e-ff4e-46cf-9507-52415323064c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b2016e-ff4e-46cf-9507-52415323064c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2c2683-6934-4088-9ccf-d604ad87371c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:11 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Volume 10ef1f51-3b90-4c25-9d8a-ba77e9c182ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec', 'volume_size': 1} Jul 24 09:48:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:12 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7f29e10d-8507-4fcc-8202-f39d00a1ce62" returned: 0 in 4.795s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:12 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da708bb-7e2f-400b-8e29-4967dc60d128]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:12 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 Jul 24 09:48:12 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:13 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8" returned: 0 in 0.529s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:13 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8, size 1024.00 MB, duration 4.80 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7f29e10d-8507-4fcc-8202-f39d00a1ce62 {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:48:13 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Converted 1024.00 MB image at 213.53 MB/s Jul 24 09:48:13 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7f29e10d-8507-4fcc-8202-f39d00a1ce62 is being set with open permissions: ugo+rw Jul 24 09:48:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7f29e10d-8507-4fcc-8202-f39d00a1ce62 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:13 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7f29e10d-8507-4fcc-8202-f39d00a1ce62 Jul 24 09:48:13 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:13 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7f29e10d-8507-4fcc-8202-f39d00a1ce62" returned: 0 in 0.261s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Lock "cinder-quobyte-7f29e10d-8507-4fcc-8202-f39d00a1ce62" released by "_copy_volume_from_snapshot" :: held 6.389s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Acquiring lock "cinder-quobyte-042de5b6-4711-47a4-9cb2-655de30af19d" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Lock "cinder-quobyte-042de5b6-4711-47a4-9cb2-655de30af19d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Deleting offline snapshot 042de5b6-4711-47a4-9cb2-655de30af19d of volume 303f07f0-0355-4253-b3b5-69a0738ed3b8 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:48:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] snapshot_file for this snap is: volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:48:13 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a025249f-53e7-41db-8f38-9f31b03d24be]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:13 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d Jul 24 09:48:13 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:13 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d" returned: 0 in 0.369s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-303f07f0-0355-4253-b3b5-69a0738ed3b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:48:13 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3f5084-12b8-432f-8236-8d9c02702c52]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:13 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 Jul 24 09:48:13 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:14 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8" returned: 0 in 0.353s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:14 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d Jul 24 09:48:14 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:14 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d" returned: 0 in 0.344s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:14 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d Jul 24 09:48:14 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:14 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8.042de5b6-4711-47a4-9cb2-655de30af19d" returned: 0 in 0.245s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:14 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Lock "cinder-quobyte-042de5b6-4711-47a4-9cb2-655de30af19d" released by "_delete_snapshot" :: held 1.402s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.261s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cdb10cf1-7fe4-453f-93e6-341f6f71aab1 tempest-CinderUnicodeTest-954483509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.906s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c5b209-a368-4986-8f75-7d6b812d6c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f29e10d-8507-4fcc-8202-f39d00a1ce62', 'volume_size': 2, 'source_volid': '303f07f0-0355-4253-b3b5-69a0738ed3b8', 'source_volstatus': 'available'}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5300b794-3cb4-45db-85e9-4b6cbdbc865d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-cdb10cf1-7fe4-453f-93e6-341f6f71aab1 tempest-CinderUnicodeTest-954483509 None] Creating offline snapshot ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4 of volume 03e9eedb-6eea-46f9-86fc-39c427812266 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:48:14 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Volume volume-7f29e10d-8507-4fcc-8202-f39d00a1ce62 (7f29e10d-8507-4fcc-8202-f39d00a1ce62): created successfully Jul 24 09:48:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5300b794-3cb4-45db-85e9-4b6cbdbc865d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Flow 'volume_create_manager' (d1fbb666-be3f-4cf6-995f-da4c9e625909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:48:14 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a03f566-6d53-451d-8dad-bb6d347135b6]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb10cf1-7fe4-453f-93e6-341f6f71aab1 tempest-CinderUnicodeTest-954483509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:14 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e68e3a79-a581-49c4-b6f8-54423ff03b45 tempest-VolumesCloneTest-2010850886 None] Created volume successfully. Jul 24 09:48:15 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266 Jul 24 09:48:15 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:48:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:15 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:48:15 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:15 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb10cf1-7fe4-453f-93e6-341f6f71aab1 tempest-CinderUnicodeTest-954483509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266" returned: 0 in 0.421s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb10cf1-7fe4-453f-93e6-341f6f71aab1 tempest-CinderUnicodeTest-954483509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:15 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.299s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:48:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:48:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 28 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:48:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:48:15 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4 1G Jul 24 09:48:15 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:15 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb10cf1-7fe4-453f-93e6-341f6f71aab1 tempest-CinderUnicodeTest-954483509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4 1G" returned: 0 in 0.464s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb10cf1-7fe4-453f-93e6-341f6f71aab1 tempest-CinderUnicodeTest-954483509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03e9eedb-6eea-46f9-86fc-39c427812266 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:15 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03e9eedb-6eea-46f9-86fc-39c427812266 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4 Jul 24 09:48:15 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:16 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb10cf1-7fe4-453f-93e6-341f6f71aab1 tempest-CinderUnicodeTest-954483509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03e9eedb-6eea-46f9-86fc-39c427812266 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4" returned: 0 in 0.313s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:16 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-cdb10cf1-7fe4-453f-93e6-341f6f71aab1 tempest-CinderUnicodeTest-954483509 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4 is being set with open permissions: ugo+rw Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb10cf1-7fe4-453f-93e6-341f6f71aab1 tempest-CinderUnicodeTest-954483509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:16 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4 Jul 24 09:48:16 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c9e8b876-94de-4123-85af-a8bc4aa57301 tempest-VolumesCloneTest-2010850886 None] Acquiring lock "cinder-7f29e10d-8507-4fcc-8202-f39d00a1ce62-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c9e8b876-94de-4123-85af-a8bc4aa57301 tempest-VolumesCloneTest-2010850886 None] Lock "cinder-7f29e10d-8507-4fcc-8202-f39d00a1ce62-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c9e8b876-94de-4123-85af-a8bc4aa57301 tempest-VolumesCloneTest-2010850886 None] Acquiring lock "cinder-quobyte-7f29e10d-8507-4fcc-8202-f39d00a1ce62" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c9e8b876-94de-4123-85af-a8bc4aa57301 tempest-VolumesCloneTest-2010850886 None] Lock "cinder-quobyte-7f29e10d-8507-4fcc-8202-f39d00a1ce62" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f10ab65-ef3e-4f25-9dce-e19703ec94fc]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c9e8b876-94de-4123-85af-a8bc4aa57301 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7f29e10d-8507-4fcc-8202-f39d00a1ce62 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:16 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb10cf1-7fe4-453f-93e6-341f6f71aab1 tempest-CinderUnicodeTest-954483509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4" returned: 0 in 0.284s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb10cf1-7fe4-453f-93e6-341f6f71aab1 tempest-CinderUnicodeTest-954483509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:16 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.info Jul 24 09:48:16 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:16 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7f29e10d-8507-4fcc-8202-f39d00a1ce62 Jul 24 09:48:16 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:16 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb10cf1-7fe4-453f-93e6-341f6f71aab1 tempest-CinderUnicodeTest-954483509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.info" returned: 0 in 0.268s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:16 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-cdb10cf1-7fe4-453f-93e6-341f6f71aab1 tempest-CinderUnicodeTest-954483509 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.info is being set with open permissions: ugo+rw Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb10cf1-7fe4-453f-93e6-341f6f71aab1 tempest-CinderUnicodeTest-954483509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:16 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:16 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.info Jul 24 09:48:16 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c9e8b876-94de-4123-85af-a8bc4aa57301 tempest-VolumesCloneTest-2010850886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7f29e10d-8507-4fcc-8202-f39d00a1ce62" returned: 0 in 0.391s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c9e8b876-94de-4123-85af-a8bc4aa57301 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7f29e10d-8507-4fcc-8202-f39d00a1ce62 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:16 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7f29e10d-8507-4fcc-8202-f39d00a1ce62 Jul 24 09:48:16 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:16 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb10cf1-7fe4-453f-93e6-341f6f71aab1 tempest-CinderUnicodeTest-954483509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.info" returned: 0 in 0.269s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cdb10cf1-7fe4-453f-93e6-341f6f71aab1 tempest-CinderUnicodeTest-954483509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.156s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:16 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.551s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-5872346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ef1f51-3b90-4c25-9d8a-ba77e9c182ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3457802bc2b34831afd7aade300294c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:48:11Z,use_quota=True,user_id='a72de313c231466c875ce495f3e132bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Creating volume 10ef1f51-3b90-4c25-9d8a-ba77e9c182ec {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:48:16 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:48:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c9e8b876-94de-4123-85af-a8bc4aa57301 tempest-VolumesCloneTest-2010850886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7f29e10d-8507-4fcc-8202-f39d00a1ce62" returned: 0 in 0.301s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:17 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec 1073741824 Jul 24 09:48:17 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c9e8b876-94de-4123-85af-a8bc4aa57301 tempest-VolumesCloneTest-2010850886 None] Lock "cinder-quobyte-7f29e10d-8507-4fcc-8202-f39d00a1ce62" released by "delete_volume" :: held 0.761s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:17 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-cdb10cf1-7fe4-453f-93e6-341f6f71aab1 tempest-CinderUnicodeTest-954483509 None] Create snapshot completed successfully Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-c9e8b876-94de-4123-85af-a8bc4aa57301 tempest-VolumesCloneTest-2010850886 None] Created reservations ['725aeb2d-e6d6-4664-b418-54686009b50e', '69e435d5-a703-483d-bf23-bdac5759701e', 'b7e0edc0-835f-41b6-a48b-1a03b59ac51c', 'a93f8e0a-dd66-47c6-9be1-6f59e86dd200'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c9e8b876-94de-4123-85af-a8bc4aa57301 tempest-VolumesCloneTest-2010850886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c9e8b876-94de-4123-85af-a8bc4aa57301 tempest-VolumesCloneTest-2010850886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c9e8b876-94de-4123-85af-a8bc4aa57301 tempest-VolumesCloneTest-2010850886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c9e8b876-94de-4123-85af-a8bc4aa57301 tempest-VolumesCloneTest-2010850886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c9e8b876-94de-4123-85af-a8bc4aa57301 tempest-VolumesCloneTest-2010850886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c9e8b876-94de-4123-85af-a8bc4aa57301 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:17 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:48:17 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:17 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c9e8b876-94de-4123-85af-a8bc4aa57301 tempest-VolumesCloneTest-2010850886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.344s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-c9e8b876-94de-4123-85af-a8bc4aa57301 tempest-VolumesCloneTest-2010850886 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:48:17 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c9e8b876-94de-4123-85af-a8bc4aa57301 tempest-VolumesCloneTest-2010850886 None] Deleted volume successfully. Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a2fdb872-cdd8-4318-b9cf-06dbbe473f32 tempest-VolumesCloneTest-2010850886 None] Acquiring lock "cinder-303f07f0-0355-4253-b3b5-69a0738ed3b8-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] Acquiring lock "cinder-ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a2fdb872-cdd8-4318-b9cf-06dbbe473f32 tempest-VolumesCloneTest-2010850886 None] Lock "cinder-303f07f0-0355-4253-b3b5-69a0738ed3b8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c9e8b876-94de-4123-85af-a8bc4aa57301 tempest-VolumesCloneTest-2010850886 None] Lock "cinder-7f29e10d-8507-4fcc-8202-f39d00a1ce62-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] Lock "cinder-ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] Acquiring lock "cinder-quobyte-03e9eedb-6eea-46f9-86fc-39c427812266" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:17 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec 1073741824" returned: 0 in 0.668s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] Lock "cinder-quobyte-03e9eedb-6eea-46f9-86fc-39c427812266" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] Acquiring lock "cinder-quobyte-ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] Lock "cinder-quobyte-ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] Deleting offline snapshot ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4 of volume 03e9eedb-6eea-46f9-86fc-39c427812266 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] snapshot_file for this snap is: volume-03e9eedb-6eea-46f9-86fc-39c427812266.ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a2fdb872-cdd8-4318-b9cf-06dbbe473f32 tempest-VolumesCloneTest-2010850886 None] Acquiring lock "cinder-quobyte-303f07f0-0355-4253-b3b5-69a0738ed3b8" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[857237dd-aa86-4254-bc6f-6ae7947be692]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:17 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec Jul 24 09:48:17 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a2fdb872-cdd8-4318-b9cf-06dbbe473f32 tempest-VolumesCloneTest-2010850886 None] Lock "cinder-quobyte-303f07f0-0355-4253-b3b5-69a0738ed3b8" acquired by "delete_volume" :: waited 0.094s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4fda3a-e1d3-42cd-a43e-5c5b0dc9dd0d]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a2fdb872-cdd8-4318-b9cf-06dbbe473f32 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:18 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4 Jul 24 09:48:18 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:18 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 Jul 24 09:48:18 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:18 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec" returned: 0 in 0.503s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2c2683-6934-4088-9ccf-d604ad87371c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c8cfae-a123-4b82-b52d-0956ad449d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:18 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Volume volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec (10ef1f51-3b90-4c25-9d8a-ba77e9c182ec): created successfully Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c8cfae-a123-4b82-b52d-0956ad449d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Flow 'volume_create_manager' (0c629cad-ad10-4ec1-8b18-403cf2f9a83d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:48:18 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-7f4fd009-68e8-43a7-84bf-a97cd5d05b0f tempest-VolumesSnapshotTestJSON-1116693304 None] Created volume successfully. Jul 24 09:48:18 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-9bafbc58-9275-4887-95de-1381c12ae110 req-40d46280-f98f-48cf-a806-84ef63dd2910 tempest-TestShelveInstance-710840937 None] Terminate volume connection completed successfully. Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-9bafbc58-9275-4887-95de-1381c12ae110 req-40d46280-f98f-48cf-a806-84ef63dd2910 tempest-TestShelveInstance-710840937 None] Deleting attachment 80c7a6cc-048a-4196-9b94-c6c4082e061d. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:48:18 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4" returned: 0 in 0.626s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03e9eedb-6eea-46f9-86fc-39c427812266(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0337da08-1c0e-49a3-8803-680a4ae5bec5]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:18 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a2fdb872-cdd8-4318-b9cf-06dbbe473f32 tempest-VolumesCloneTest-2010850886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8" returned: 0 in 0.518s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a2fdb872-cdd8-4318-b9cf-06dbbe473f32 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:18 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8 Jul 24 09:48:18 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:18 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266 Jul 24 09:48:18 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:18 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a2fdb872-cdd8-4318-b9cf-06dbbe473f32 tempest-VolumesCloneTest-2010850886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-303f07f0-0355-4253-b3b5-69a0738ed3b8" returned: 0 in 0.302s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a2fdb872-cdd8-4318-b9cf-06dbbe473f32 tempest-VolumesCloneTest-2010850886 None] Lock "cinder-quobyte-303f07f0-0355-4253-b3b5-69a0738ed3b8" released by "delete_volume" :: held 0.939s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-be7f392e-243d-4026-85be-32e8498e3712 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-be7f392e-243d-4026-85be-32e8498e3712 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-be7f392e-243d-4026-85be-32e8498e3712 tempest-VolumesSnapshotTestJSON-1116693304 None] Creating offline snapshot fd2699b7-e715-40fe-a457-b8849ce0a3f4 of volume 10ef1f51-3b90-4c25-9d8a-ba77e9c182ec {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-a2fdb872-cdd8-4318-b9cf-06dbbe473f32 tempest-VolumesCloneTest-2010850886 None] Created reservations ['4f12d6ca-c7d2-4e2f-ae15-e6d08cee7ac1', '03b322ae-abd6-4661-ac7a-643b0b89d84a', '98250890-63cd-44d6-96c0-e03957dc2176', '2bf39d19-58ac-454f-836c-d5ce9c57bad4'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de627d6-ec2c-46e5-b9d7-a062024ee0da]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be7f392e-243d-4026-85be-32e8498e3712 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:18 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266" returned: 0 in 0.484s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:18 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4 Jul 24 09:48:18 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a2fdb872-cdd8-4318-b9cf-06dbbe473f32 tempest-VolumesCloneTest-2010850886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a2fdb872-cdd8-4318-b9cf-06dbbe473f32 tempest-VolumesCloneTest-2010850886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a2fdb872-cdd8-4318-b9cf-06dbbe473f32 tempest-VolumesCloneTest-2010850886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a2fdb872-cdd8-4318-b9cf-06dbbe473f32 tempest-VolumesCloneTest-2010850886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a2fdb872-cdd8-4318-b9cf-06dbbe473f32 tempest-VolumesCloneTest-2010850886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a2fdb872-cdd8-4318-b9cf-06dbbe473f32 tempest-VolumesCloneTest-2010850886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:19 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec Jul 24 09:48:19 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:19 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:48:19 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:19 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a2fdb872-cdd8-4318-b9cf-06dbbe473f32 tempest-VolumesCloneTest-2010850886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.254s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:19 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-a2fdb872-cdd8-4318-b9cf-06dbbe473f32 tempest-VolumesCloneTest-2010850886 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:48:19 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-a2fdb872-cdd8-4318-b9cf-06dbbe473f32 tempest-VolumesCloneTest-2010850886 None] Deleted volume successfully. Jul 24 09:48:19 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be7f392e-243d-4026-85be-32e8498e3712 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec" returned: 0 in 0.386s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be7f392e-243d-4026-85be-32e8498e3712 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a2fdb872-cdd8-4318-b9cf-06dbbe473f32 tempest-VolumesCloneTest-2010850886 None] Lock "cinder-303f07f0-0355-4253-b3b5-69a0738ed3b8-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:19 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:19 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4 1G Jul 24 09:48:19 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4" returned: 0 in 0.398s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:19 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4 Jul 24 09:48:19 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:19 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266.ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4" returned: 0 in 0.269s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] Lock "cinder-quobyte-ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4" released by "_delete_snapshot" :: held 1.938s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] Lock "cinder-quobyte-03e9eedb-6eea-46f9-86fc-39c427812266" released by "delete_snapshot" :: held 1.974s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:19 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] Created reservations ['9a7586c7-7cd2-4e86-aed5-3483be0b4483', 'af930105-2766-4c92-8cd4-2b9a1b6c2ab3', '6956fcff-823f-4da3-9494-d02d857bb837', '56e87de8-46f1-44cb-ac19-af9da41d6bd5'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:48:19 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be7f392e-243d-4026-85be-32e8498e3712 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4 1G" returned: 0 in 0.460s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be7f392e-243d-4026-85be-32e8498e3712 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:19 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4 Jul 24 09:48:19 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:19 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] Delete snapshot completed successfully. Jul 24 09:48:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-941a8695-7011-4175-9dba-6ae5ae33f3f1 tempest-CinderUnicodeTest-954483509 None] Lock "cinder-ae9ceb1e-3dbf-442a-9b7a-7186b240c1f4-delete_snapshot" released by "delete_snapshot" :: held 2.184s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:20 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be7f392e-243d-4026-85be-32e8498e3712 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4" returned: 0 in 0.356s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:20 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-be7f392e-243d-4026-85be-32e8498e3712 tempest-VolumesSnapshotTestJSON-1116693304 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4 is being set with open permissions: ugo+rw Jul 24 09:48:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be7f392e-243d-4026-85be-32e8498e3712 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:20 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4 Jul 24 09:48:20 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:20 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be7f392e-243d-4026-85be-32e8498e3712 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4" returned: 0 in 0.290s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be7f392e-243d-4026-85be-32e8498e3712 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:20 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.info Jul 24 09:48:20 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:20 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be7f392e-243d-4026-85be-32e8498e3712 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.info" returned: 0 in 0.312s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:20 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-be7f392e-243d-4026-85be-32e8498e3712 tempest-VolumesSnapshotTestJSON-1116693304 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.info is being set with open permissions: ugo+rw Jul 24 09:48:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be7f392e-243d-4026-85be-32e8498e3712 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:20 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.info Jul 24 09:48:20 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-47eb0bdc-6c48-4c0d-8bc4-66035914c381 tempest-CinderUnicodeTest-954483509 None] Acquiring lock "cinder-03e9eedb-6eea-46f9-86fc-39c427812266-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-47eb0bdc-6c48-4c0d-8bc4-66035914c381 tempest-CinderUnicodeTest-954483509 None] Lock "cinder-03e9eedb-6eea-46f9-86fc-39c427812266-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-47eb0bdc-6c48-4c0d-8bc4-66035914c381 tempest-CinderUnicodeTest-954483509 None] Acquiring lock "cinder-quobyte-03e9eedb-6eea-46f9-86fc-39c427812266" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-47eb0bdc-6c48-4c0d-8bc4-66035914c381 tempest-CinderUnicodeTest-954483509 None] Lock "cinder-quobyte-03e9eedb-6eea-46f9-86fc-39c427812266" acquired by "delete_volume" :: waited 0.050s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:21 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[172db24b-f3f8-45d3-836e-4e5a5e675b93]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-47eb0bdc-6c48-4c0d-8bc4-66035914c381 tempest-CinderUnicodeTest-954483509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:21 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be7f392e-243d-4026-85be-32e8498e3712 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.info" returned: 0 in 0.346s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-be7f392e-243d-4026-85be-32e8498e3712 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.271s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:21 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-be7f392e-243d-4026-85be-32e8498e3712 tempest-VolumesSnapshotTestJSON-1116693304 None] Create snapshot completed successfully Jul 24 09:48:21 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266 Jul 24 09:48:21 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-191fe46c-c768-41e8-bfe1-a6ca10c7fa0e req-563741c3-bfa8-4786-be85-0dfd174df024 tempest-TestShelveInstance-710840937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-191fe46c-c768-41e8-bfe1-a6ca10c7fa0e req-563741c3-bfa8-4786-be85-0dfd174df024 tempest-TestShelveInstance-710840937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-191fe46c-c768-41e8-bfe1-a6ca10c7fa0e req-563741c3-bfa8-4786-be85-0dfd174df024 tempest-TestShelveInstance-710840937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:21 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:21 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-191fe46c-c768-41e8-bfe1-a6ca10c7fa0e req-563741c3-bfa8-4786-be85-0dfd174df024 tempest-TestShelveInstance-710840937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-1812af6a-17c6-4573-aa4a-c86d480ad012', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf73b549-e071-4cd4-af81-754ed52fd4f0', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:48:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-47eb0bdc-6c48-4c0d-8bc4-66035914c381 tempest-CinderUnicodeTest-954483509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266" returned: 0 in 0.531s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-47eb0bdc-6c48-4c0d-8bc4-66035914c381 tempest-CinderUnicodeTest-954483509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:21 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266 Jul 24 09:48:21 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:21 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-191fe46c-c768-41e8-bfe1-a6ca10c7fa0e req-563741c3-bfa8-4786-be85-0dfd174df024 tempest-TestShelveInstance-710840937 None] attachment_update completed successfully. Jul 24 09:48:21 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-47eb0bdc-6c48-4c0d-8bc4-66035914c381 tempest-CinderUnicodeTest-954483509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03e9eedb-6eea-46f9-86fc-39c427812266" returned: 0 in 0.283s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:21 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-47eb0bdc-6c48-4c0d-8bc4-66035914c381 tempest-CinderUnicodeTest-954483509 None] Lock "cinder-quobyte-03e9eedb-6eea-46f9-86fc-39c427812266" released by "delete_volume" :: held 0.916s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:21 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-47eb0bdc-6c48-4c0d-8bc4-66035914c381 tempest-CinderUnicodeTest-954483509 None] Created reservations ['85800976-fb3c-4a9a-ae75-76cd4afb251c', '6cba4a2c-b686-4393-8845-c2ce89975562', 'b16f551b-4da9-4998-86dc-da64b698c33a', '959feb9f-0477-4618-a0fa-65461a696bac'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:48:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-47eb0bdc-6c48-4c0d-8bc4-66035914c381 tempest-CinderUnicodeTest-954483509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-47eb0bdc-6c48-4c0d-8bc4-66035914c381 tempest-CinderUnicodeTest-954483509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:22 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-47eb0bdc-6c48-4c0d-8bc4-66035914c381 tempest-CinderUnicodeTest-954483509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:22 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-47eb0bdc-6c48-4c0d-8bc4-66035914c381 tempest-CinderUnicodeTest-954483509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-47eb0bdc-6c48-4c0d-8bc4-66035914c381 tempest-CinderUnicodeTest-954483509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-47eb0bdc-6c48-4c0d-8bc4-66035914c381 tempest-CinderUnicodeTest-954483509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:22 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:48:22 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:22 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-62dd73d5-adb8-40ea-aced-e3758b820a26 tempest-CinderUnicodeTest-954483509 None] Acquiring lock "cinder-b6757058-85c9-40bd-acc4-62de61980b90-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:22 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-62dd73d5-adb8-40ea-aced-e3758b820a26 tempest-CinderUnicodeTest-954483509 None] Lock "cinder-b6757058-85c9-40bd-acc4-62de61980b90-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:22 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-62dd73d5-adb8-40ea-aced-e3758b820a26 tempest-CinderUnicodeTest-954483509 None] Acquiring lock "cinder-quobyte-b6757058-85c9-40bd-acc4-62de61980b90" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:22 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-62dd73d5-adb8-40ea-aced-e3758b820a26 tempest-CinderUnicodeTest-954483509 None] Lock "cinder-quobyte-b6757058-85c9-40bd-acc4-62de61980b90" acquired by "delete_volume" :: waited 0.024s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:22 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5c70a9-414a-4a33-9b95-aaa07154ffaf]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-62dd73d5-adb8-40ea-aced-e3758b820a26 tempest-CinderUnicodeTest-954483509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6757058-85c9-40bd-acc4-62de61980b90 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:22 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-47eb0bdc-6c48-4c0d-8bc4-66035914c381 tempest-CinderUnicodeTest-954483509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.524s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:22 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-47eb0bdc-6c48-4c0d-8bc4-66035914c381 tempest-CinderUnicodeTest-954483509 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:48:22 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-47eb0bdc-6c48-4c0d-8bc4-66035914c381 tempest-CinderUnicodeTest-954483509 None] Deleted volume successfully. Jul 24 09:48:22 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-47eb0bdc-6c48-4c0d-8bc4-66035914c381 tempest-CinderUnicodeTest-954483509 None] Lock "cinder-03e9eedb-6eea-46f9-86fc-39c427812266-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:22 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6757058-85c9-40bd-acc4-62de61980b90 Jul 24 09:48:22 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:23 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-62dd73d5-adb8-40ea-aced-e3758b820a26 tempest-CinderUnicodeTest-954483509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6757058-85c9-40bd-acc4-62de61980b90" returned: 0 in 0.544s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-62dd73d5-adb8-40ea-aced-e3758b820a26 tempest-CinderUnicodeTest-954483509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6757058-85c9-40bd-acc4-62de61980b90 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:48:23 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6757058-85c9-40bd-acc4-62de61980b90 Jul 24 09:48:23 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Flow 'volume_create_manager' (07e8eedc-04e8-4649-86b2-44454daf0458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfe33a7-1d85-4573-a943-3057cb996106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfe33a7-1d85-4573-a943-3057cb996106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-700833966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cf2d631-ff93-4fa6-b031-f26d6e38ab3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3457802bc2b34831afd7aade300294c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fd2699b7-e715-40fe-a457-b8849ce0a3f4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:48:23Z,use_quota=True,user_id='a72de313c231466c875ce495f3e132bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3176f53-a569-4cb3-a22d-f69ad1bf7bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3176f53-a569-4cb3-a22d-f69ad1bf7bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f73438a-9deb-4c6d-82d2-b5c8e498b2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f73438a-9deb-4c6d-82d2-b5c8e498b2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8cf2d631-ff93-4fa6-b031-f26d6e38ab3b', 'volume_name': 'volume-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b', 'volume_size': 1, 'snapshot_id': 'fd2699b7-e715-40fe-a457-b8849ce0a3f4'}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece4070d-22ad-42bc-a814-1aca1aca5d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece4070d-22ad-42bc-a814-1aca1aca5d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff8abe02-072d-4c61-b008-eba39a7b07fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:23 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Volume 8cf2d631-ff93-4fa6-b031-f26d6e38ab3b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b', 'volume_size': 1, 'snapshot_id': 'fd2699b7-e715-40fe-a457-b8849ce0a3f4'} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-quobyte-fd2699b7-e715-40fe-a457-b8849ce0a3f4-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b" by "_create_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-fd2699b7-e715-40fe-a457-b8849ce0a3f4-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Creating volume 8cf2d631-ff93-4fa6-b031-f26d6e38ab3b from snapshot fd2699b7-e715-40fe-a457-b8849ce0a3f4 {{(pid=88488) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-quobyte-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b" by "_copy_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] snapshot: fd2699b7-e715-40fe-a457-b8849ce0a3f4, volume: 8cf2d631-ff93-4fa6-b031-f26d6e38ab3b, {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[996f20ee-e7bc-46c8-9800-099c7631d8eb]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:23 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-62dd73d5-adb8-40ea-aced-e3758b820a26 tempest-CinderUnicodeTest-954483509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b6757058-85c9-40bd-acc4-62de61980b90" returned: 0 in 0.379s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-62dd73d5-adb8-40ea-aced-e3758b820a26 tempest-CinderUnicodeTest-954483509 None] Lock "cinder-quobyte-b6757058-85c9-40bd-acc4-62de61980b90" released by "delete_volume" :: held 1.045s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:23 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4 Jul 24 09:48:23 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-62dd73d5-adb8-40ea-aced-e3758b820a26 tempest-CinderUnicodeTest-954483509 None] Created reservations ['fcd117f4-abc1-4758-b2ae-ff8d0c97eeff', '505d641a-64ab-4b1e-bd94-7b1478306b67', '7bb74b4b-be5a-4e46-bddf-07a1a1a13397', '7cfbf410-45bd-41b0-aa92-94cb637fdf34'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-62dd73d5-adb8-40ea-aced-e3758b820a26 tempest-CinderUnicodeTest-954483509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-62dd73d5-adb8-40ea-aced-e3758b820a26 tempest-CinderUnicodeTest-954483509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-62dd73d5-adb8-40ea-aced-e3758b820a26 tempest-CinderUnicodeTest-954483509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-62dd73d5-adb8-40ea-aced-e3758b820a26 tempest-CinderUnicodeTest-954483509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-62dd73d5-adb8-40ea-aced-e3758b820a26 tempest-CinderUnicodeTest-954483509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-62dd73d5-adb8-40ea-aced-e3758b820a26 tempest-CinderUnicodeTest-954483509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:23 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:48:23 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:23 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4" returned: 0 in 0.514s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Creating direct copy from snapshot {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[de362b76-0925-4dd5-b06d-69978113f4e2]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:23 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-62dd73d5-adb8-40ea-aced-e3758b820a26 tempest-CinderUnicodeTest-954483509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.307s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-62dd73d5-adb8-40ea-aced-e3758b820a26 tempest-CinderUnicodeTest-954483509 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:48:23 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-62dd73d5-adb8-40ea-aced-e3758b820a26 tempest-CinderUnicodeTest-954483509 None] Deleted volume successfully. Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Flow 'volume_create_manager' (6890bfde-e783-489f-8e76-6350ceae3038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:48:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e775f5-24ca-42c6-bdc0-94a2372bee7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e775f5-24ca-42c6-bdc0-94a2372bee7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-44884085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1726eafd-b7d3-4921-a7db-a63da2cf91ab,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2e28ae48bd094bb3b3ac7c724e25d2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:48:24Z,use_quota=True,user_id='09715880c7804d5daeeb9b89629d5c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b502b5a5-075e-452c-9600-b6c0cdab4a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b502b5a5-075e-452c-9600-b6c0cdab4a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0bf64c2-a45e-4ff6-bea7-094d541179d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0bf64c2-a45e-4ff6-bea7-094d541179d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1726eafd-b7d3-4921-a7db-a63da2cf91ab', 'volume_name': 'volume-1726eafd-b7d3-4921-a7db-a63da2cf91ab', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57ed3f2-b764-4417-b89a-7d5b5326bcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:24 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec Jul 24 09:48:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57ed3f2-b764-4417-b89a-7d5b5326bcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:24 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93ce781-1271-4d77-9782-6226357de957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:24 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Volume 1726eafd-b7d3-4921-a7db-a63da2cf91ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1726eafd-b7d3-4921-a7db-a63da2cf91ab', 'volume_size': 1} Jul 24 09:48:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-62dd73d5-adb8-40ea-aced-e3758b820a26 tempest-CinderUnicodeTest-954483509 None] Lock "cinder-b6757058-85c9-40bd-acc4-62de61980b90-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:24 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec" returned: 0 in 0.449s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:24 devstack cinder-volume[88488]: DEBUG cinder.utils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Path /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b not found in is_blk_device check {{(pid=88488) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 09:48:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:24 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b Jul 24 09:48:24 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:30 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b" returned: 0 in 6.476s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:30 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0e8a91-e5e5-4766-89c6-4d2d848c0aad]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:31 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec Jul 24 09:48:31 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:31 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec" returned: 0 in 0.710s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:31 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec, size 1024.00 MB, duration 6.48 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:48:31 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Converted 1024.00 MB image at 158.08 MB/s Jul 24 09:48:31 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b is being set with open permissions: ugo+rw Jul 24 09:48:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:31 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b Jul 24 09:48:31 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:31 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b" returned: 0 in 0.292s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b" released by "_copy_volume_from_snapshot" :: held 8.597s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-fd2699b7-e715-40fe-a457-b8849ce0a3f4-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b" released by "_create_volume_from_snapshot" :: held 8.657s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.687s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.828s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-44884085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1726eafd-b7d3-4921-a7db-a63da2cf91ab,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2e28ae48bd094bb3b3ac7c724e25d2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:48:24Z,use_quota=True,user_id='09715880c7804d5daeeb9b89629d5c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:48:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Creating volume 1726eafd-b7d3-4921-a7db-a63da2cf91ab {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:48:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:48:31 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:48:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1726eafd-b7d3-4921-a7db-a63da2cf91ab 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:31 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=137,cinder:UPDATE=154,cinder:INSERT=47,cinder:DELETE=15 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:48:31 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1726eafd-b7d3-4921-a7db-a63da2cf91ab 1073741824 Jul 24 09:48:31 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:31 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=152,cinder:INSERT=39,cinder:DELETE=12,cinder:UPDATE=145 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:48:31 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff8abe02-072d-4c61-b008-eba39a7b07fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b', 'volume_size': 1, 'snapshot_id': 'fd2699b7-e715-40fe-a457-b8849ce0a3f4'}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (280eca3d-02ec-4976-95bd-b574baf1b2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:32 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Volume volume-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b (8cf2d631-ff93-4fa6-b031-f26d6e38ab3b): created successfully Jul 24 09:48:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (280eca3d-02ec-4976-95bd-b574baf1b2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Flow 'volume_create_manager' (07e8eedc-04e8-4649-86b2-44454daf0458) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:48:32 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-4bc3175d-cace-4300-bbe2-68f15193b56c tempest-VolumesSnapshotTestJSON-1116693304 None] Created volume successfully. Jul 24 09:48:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9c4d11ce-8399-4664-9a13-2ee0d36b15e1 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9c4d11ce-8399-4664-9a13-2ee0d36b15e1 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9c4d11ce-8399-4664-9a13-2ee0d36b15e1 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-quobyte-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9c4d11ce-8399-4664-9a13-2ee0d36b15e1 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b" acquired by "delete_volume" :: waited 0.024s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:32 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e4dd1f-8425-4e19-8a89-4f81c5b1d35b]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9c4d11ce-8399-4664-9a13-2ee0d36b15e1 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:32 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1726eafd-b7d3-4921-a7db-a63da2cf91ab 1073741824" returned: 0 in 0.757s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:32 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b Jul 24 09:48:32 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1726eafd-b7d3-4921-a7db-a63da2cf91ab {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:32 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1726eafd-b7d3-4921-a7db-a63da2cf91ab Jul 24 09:48:32 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:33 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9c4d11ce-8399-4664-9a13-2ee0d36b15e1 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b" returned: 0 in 0.505s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9c4d11ce-8399-4664-9a13-2ee0d36b15e1 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:33 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b Jul 24 09:48:33 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:33 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1726eafd-b7d3-4921-a7db-a63da2cf91ab" returned: 0 in 0.410s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93ce781-1271-4d77-9782-6226357de957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1726eafd-b7d3-4921-a7db-a63da2cf91ab', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92732db9-2ba7-4c57-9d37-d6324bd92edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:33 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Volume volume-1726eafd-b7d3-4921-a7db-a63da2cf91ab (1726eafd-b7d3-4921-a7db-a63da2cf91ab): created successfully Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92732db9-2ba7-4c57-9d37-d6324bd92edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Flow 'volume_create_manager' (6890bfde-e783-489f-8e76-6350ceae3038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:48:33 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-89c818e2-f0c0-4d36-b20a-b6c0c7e5fe93 tempest-VolumesGetTest-365468319 None] Created volume successfully. Jul 24 09:48:33 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9c4d11ce-8399-4664-9a13-2ee0d36b15e1 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b" returned: 0 in 0.342s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9c4d11ce-8399-4664-9a13-2ee0d36b15e1 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b" released by "delete_volume" :: held 0.911s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-9c4d11ce-8399-4664-9a13-2ee0d36b15e1 tempest-VolumesSnapshotTestJSON-1116693304 None] Created reservations ['e3a5f836-1426-46ba-a16d-435f8f656d1e', '0e93bddb-1eed-4aff-894a-c16cdeb55190', 'e68ef0bd-544e-43b1-9b14-7055e3f38c66', '79eb78c2-fd98-4a44-8c4f-3fed326c3366'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9c4d11ce-8399-4664-9a13-2ee0d36b15e1 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9c4d11ce-8399-4664-9a13-2ee0d36b15e1 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9c4d11ce-8399-4664-9a13-2ee0d36b15e1 tempest-VolumesSnapshotTestJSON-1116693304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9c4d11ce-8399-4664-9a13-2ee0d36b15e1 tempest-VolumesSnapshotTestJSON-1116693304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9c4d11ce-8399-4664-9a13-2ee0d36b15e1 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9c4d11ce-8399-4664-9a13-2ee0d36b15e1 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:33 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:48:33 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-fd2699b7-e715-40fe-a457-b8849ce0a3f4-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-fd2699b7-e715-40fe-a457-b8849ce0a3f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-quobyte-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-quobyte-fd2699b7-e715-40fe-a457-b8849ce0a3f4" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-fd2699b7-e715-40fe-a457-b8849ce0a3f4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] Deleting offline snapshot fd2699b7-e715-40fe-a457-b8849ce0a3f4 of volume 10ef1f51-3b90-4c25-9d8a-ba77e9c182ec {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] snapshot_file for this snap is: volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e6fdaa-d4d9-4c07-8b48-7a8b64d4256c]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:33 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9c4d11ce-8399-4664-9a13-2ee0d36b15e1 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.350s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-9c4d11ce-8399-4664-9a13-2ee0d36b15e1 tempest-VolumesSnapshotTestJSON-1116693304 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:48:33 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-9c4d11ce-8399-4664-9a13-2ee0d36b15e1 tempest-VolumesSnapshotTestJSON-1116693304 None] Deleted volume successfully. Jul 24 09:48:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9c4d11ce-8399-4664-9a13-2ee0d36b15e1 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-8cf2d631-ff93-4fa6-b031-f26d6e38ab3b-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:33 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4 Jul 24 09:48:33 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:34 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4" returned: 0 in 0.486s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:34 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:48:34 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33e15ab-341a-4c1b-a594-c330aa51b834]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:34 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec Jul 24 09:48:34 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:34 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec" returned: 0 in 0.548s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:34 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4 Jul 24 09:48:34 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:35 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4" returned: 0 in 0.424s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:35 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4 Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:48:35 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Flow 'volume_create_manager' (a8c75cf0-1266-4d20-a3dc-07d4f2d5694f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb6dde1-c97a-4d2e-ac9e-edb348657373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb6dde1-c97a-4d2e-ac9e-edb348657373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:48:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-729880328',display_name='tempest-VolumesGetTest-Volume-492977568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2e1625-2ddf-4079-a40c-58a87087e11d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e28ae48bd094bb3b3ac7c724e25d2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:48:35Z,use_quota=True,user_id='09715880c7804d5daeeb9b89629d5c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01090ccc-f228-4c63-ace5-0dae51bd2775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01090ccc-f228-4c63-ace5-0dae51bd2775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04712c05-4bac-4478-9d5a-5efe6cfa37e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04712c05-4bac-4478-9d5a-5efe6cfa37e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae2e1625-2ddf-4079-a40c-58a87087e11d', 'volume_name': 'volume-ae2e1625-2ddf-4079-a40c-58a87087e11d', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0647f56-cdd3-4eb1-bb1e-85d19647dedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0647f56-cdd3-4eb1-bb1e-85d19647dedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58cfbb56-0fd2-493f-b805-1c21ba70a1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:35 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Volume ae2e1625-2ddf-4079-a40c-58a87087e11d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae2e1625-2ddf-4079-a40c-58a87087e11d', 'volume_size': 1} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:48:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-729880328',display_name='tempest-VolumesGetTest-Volume-492977568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2e1625-2ddf-4079-a40c-58a87087e11d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e28ae48bd094bb3b3ac7c724e25d2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:48:35Z,use_quota=True,user_id='09715880c7804d5daeeb9b89629d5c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Creating volume ae2e1625-2ddf-4079-a40c-58a87087e11d {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:48:35 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ae2e1625-2ddf-4079-a40c-58a87087e11d 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:35 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ae2e1625-2ddf-4079-a40c-58a87087e11d 1073741824 Jul 24 09:48:35 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:35 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec.fd2699b7-e715-40fe-a457-b8849ce0a3f4" returned: 0 in 0.413s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-fd2699b7-e715-40fe-a457-b8849ce0a3f4" released by "_delete_snapshot" :: held 2.019s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec" released by "delete_snapshot" :: held 2.054s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:35 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] Created reservations ['f5cfb2ee-aba5-4552-a57c-7bf5e99cbcc9', '2f41d7b4-a9ff-49fd-be1d-1c8b239a4554', '9aad4456-47b3-422a-8664-537c18b11296', '472f812a-be1f-4a60-a179-1d99e25e143b'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:48:36 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] Delete snapshot completed successfully. Jul 24 09:48:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eeb27b1e-78c0-41c8-bc55-93600541c783 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-fd2699b7-e715-40fe-a457-b8849ce0a3f4-delete_snapshot" released by "delete_snapshot" :: held 2.276s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:36 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ae2e1625-2ddf-4079-a40c-58a87087e11d 1073741824" returned: 0 in 0.573s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ae2e1625-2ddf-4079-a40c-58a87087e11d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:36 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ae2e1625-2ddf-4079-a40c-58a87087e11d Jul 24 09:48:36 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:36 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ae2e1625-2ddf-4079-a40c-58a87087e11d" returned: 0 in 0.371s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:36 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:48:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58cfbb56-0fd2-493f-b805-1c21ba70a1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae2e1625-2ddf-4079-a40c-58a87087e11d', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0f41f6-9b7d-458d-b817-995a042035fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:36 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Volume volume-ae2e1625-2ddf-4079-a40c-58a87087e11d (ae2e1625-2ddf-4079-a40c-58a87087e11d): created successfully Jul 24 09:48:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0f41f6-9b7d-458d-b817-995a042035fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Flow 'volume_create_manager' (a8c75cf0-1266-4d20-a3dc-07d4f2d5694f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:48:36 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-2e665d6d-59d5-4d59-90d9-b9c7f9514310 tempest-VolumesGetTest-365468319 None] Created volume successfully. Jul 24 09:48:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-67cdddfe-7ba1-41d2-9a00-6a11cc8cbbb5 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-67cdddfe-7ba1-41d2-9a00-6a11cc8cbbb5 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-67cdddfe-7ba1-41d2-9a00-6a11cc8cbbb5 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-quobyte-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-67cdddfe-7ba1-41d2-9a00-6a11cc8cbbb5 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec" acquired by "delete_volume" :: waited 0.014s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:37 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[af83027c-bbae-4c12-806b-62b80cd514b6]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-67cdddfe-7ba1-41d2-9a00-6a11cc8cbbb5 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:37 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec Jul 24 09:48:37 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3f084490-55e8-4efc-a4d5-21ad54b1b25f tempest-VolumesGetTest-365468319 None] Acquiring lock "cinder-ae2e1625-2ddf-4079-a40c-58a87087e11d-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3f084490-55e8-4efc-a4d5-21ad54b1b25f tempest-VolumesGetTest-365468319 None] Lock "cinder-ae2e1625-2ddf-4079-a40c-58a87087e11d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:37 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-67cdddfe-7ba1-41d2-9a00-6a11cc8cbbb5 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec" returned: 0 in 0.420s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-67cdddfe-7ba1-41d2-9a00-6a11cc8cbbb5 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:37 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec Jul 24 09:48:37 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3f084490-55e8-4efc-a4d5-21ad54b1b25f tempest-VolumesGetTest-365468319 None] Acquiring lock "cinder-quobyte-ae2e1625-2ddf-4079-a40c-58a87087e11d" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3f084490-55e8-4efc-a4d5-21ad54b1b25f tempest-VolumesGetTest-365468319 None] Lock "cinder-quobyte-ae2e1625-2ddf-4079-a40c-58a87087e11d" acquired by "delete_volume" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:37 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[657cf32e-fcfc-4531-bb72-cd5adfcfaeea]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3f084490-55e8-4efc-a4d5-21ad54b1b25f tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ae2e1625-2ddf-4079-a40c-58a87087e11d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:37 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ae2e1625-2ddf-4079-a40c-58a87087e11d Jul 24 09:48:37 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:38 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-67cdddfe-7ba1-41d2-9a00-6a11cc8cbbb5 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec" returned: 0 in 0.366s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-67cdddfe-7ba1-41d2-9a00-6a11cc8cbbb5 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec" released by "delete_volume" :: held 0.870s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-67cdddfe-7ba1-41d2-9a00-6a11cc8cbbb5 tempest-VolumesSnapshotTestJSON-1116693304 None] Created reservations ['ac2b3899-d7ca-4dfe-bc52-0f214d26ddbc', '2c5abe3d-1f06-4d3c-84bd-64dea6d5ec46', '2cc09b44-a022-43c9-9be8-228f42b5939f', '86bf7b85-b803-4ff0-be21-b480f88c143c'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-67cdddfe-7ba1-41d2-9a00-6a11cc8cbbb5 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-67cdddfe-7ba1-41d2-9a00-6a11cc8cbbb5 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-67cdddfe-7ba1-41d2-9a00-6a11cc8cbbb5 tempest-VolumesSnapshotTestJSON-1116693304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-67cdddfe-7ba1-41d2-9a00-6a11cc8cbbb5 tempest-VolumesSnapshotTestJSON-1116693304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-67cdddfe-7ba1-41d2-9a00-6a11cc8cbbb5 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-67cdddfe-7ba1-41d2-9a00-6a11cc8cbbb5 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:38 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:48:38 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:38 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3f084490-55e8-4efc-a4d5-21ad54b1b25f tempest-VolumesGetTest-365468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ae2e1625-2ddf-4079-a40c-58a87087e11d" returned: 0 in 0.560s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3f084490-55e8-4efc-a4d5-21ad54b1b25f tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ae2e1625-2ddf-4079-a40c-58a87087e11d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:38 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ae2e1625-2ddf-4079-a40c-58a87087e11d Jul 24 09:48:38 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-014930e7-bede-407a-bb78-87036f05c7e6 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-e58afd74-d43a-44d9-b3ca-28d121d76081-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-014930e7-bede-407a-bb78-87036f05c7e6 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-e58afd74-d43a-44d9-b3ca-28d121d76081-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-014930e7-bede-407a-bb78-87036f05c7e6 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "cinder-quobyte-e58afd74-d43a-44d9-b3ca-28d121d76081" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-014930e7-bede-407a-bb78-87036f05c7e6 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-e58afd74-d43a-44d9-b3ca-28d121d76081" acquired by "delete_volume" :: waited 0.033s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:38 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-67cdddfe-7ba1-41d2-9a00-6a11cc8cbbb5 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.502s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-67cdddfe-7ba1-41d2-9a00-6a11cc8cbbb5 tempest-VolumesSnapshotTestJSON-1116693304 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:48:38 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-67cdddfe-7ba1-41d2-9a00-6a11cc8cbbb5 tempest-VolumesSnapshotTestJSON-1116693304 None] Deleted volume successfully. Jul 24 09:48:38 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[652ca6ca-ce83-4e8a-b60f-04b3b0105c39]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-014930e7-bede-407a-bb78-87036f05c7e6 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3f084490-55e8-4efc-a4d5-21ad54b1b25f tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ae2e1625-2ddf-4079-a40c-58a87087e11d" returned: 0 in 0.438s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3f084490-55e8-4efc-a4d5-21ad54b1b25f tempest-VolumesGetTest-365468319 None] Lock "cinder-quobyte-ae2e1625-2ddf-4079-a40c-58a87087e11d" released by "delete_volume" :: held 1.076s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-67cdddfe-7ba1-41d2-9a00-6a11cc8cbbb5 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-10ef1f51-3b90-4c25-9d8a-ba77e9c182ec-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:38 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-3f084490-55e8-4efc-a4d5-21ad54b1b25f tempest-VolumesGetTest-365468319 None] Created reservations ['f77279fc-e3d4-4adf-b5f7-9461ae9869e3', 'e2fd39ec-122a-425e-b3b4-b42e7f9846d2', '4762e7c7-4bfe-4187-90af-0ce6e5977f6a', '7f71cdca-3477-4d8b-97b8-8d2f2882f840'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:48:38 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081 Jul 24 09:48:38 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3f084490-55e8-4efc-a4d5-21ad54b1b25f tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3f084490-55e8-4efc-a4d5-21ad54b1b25f tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3f084490-55e8-4efc-a4d5-21ad54b1b25f tempest-VolumesGetTest-365468319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3f084490-55e8-4efc-a4d5-21ad54b1b25f tempest-VolumesGetTest-365468319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3f084490-55e8-4efc-a4d5-21ad54b1b25f tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3f084490-55e8-4efc-a4d5-21ad54b1b25f tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:39 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:48:39 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:39 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-014930e7-bede-407a-bb78-87036f05c7e6 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081" returned: 0 in 0.488s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-014930e7-bede-407a-bb78-87036f05c7e6 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:39 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081 Jul 24 09:48:39 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:39 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3f084490-55e8-4efc-a4d5-21ad54b1b25f tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.296s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-3f084490-55e8-4efc-a4d5-21ad54b1b25f tempest-VolumesGetTest-365468319 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:48:39 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-3f084490-55e8-4efc-a4d5-21ad54b1b25f tempest-VolumesGetTest-365468319 None] Deleted volume successfully. Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3f084490-55e8-4efc-a4d5-21ad54b1b25f tempest-VolumesGetTest-365468319 None] Lock "cinder-ae2e1625-2ddf-4079-a40c-58a87087e11d-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:39 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-014930e7-bede-407a-bb78-87036f05c7e6 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e58afd74-d43a-44d9-b3ca-28d121d76081" returned: 0 in 0.263s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-014930e7-bede-407a-bb78-87036f05c7e6 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-quobyte-e58afd74-d43a-44d9-b3ca-28d121d76081" released by "delete_volume" :: held 0.819s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-014930e7-bede-407a-bb78-87036f05c7e6 tempest-VolumesSnapshotTestJSON-1116693304 None] Created reservations ['0ac8946b-8283-41f4-b3d1-bd7acf616462', 'e5dc5fee-347f-4182-b594-e8b5210d1e88', '83849912-8f63-4980-b049-065dc5be70e9', 'a927c85d-9146-4834-9b97-76f15ce2f517'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-014930e7-bede-407a-bb78-87036f05c7e6 tempest-VolumesSnapshotTestJSON-1116693304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-014930e7-bede-407a-bb78-87036f05c7e6 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-014930e7-bede-407a-bb78-87036f05c7e6 tempest-VolumesSnapshotTestJSON-1116693304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-014930e7-bede-407a-bb78-87036f05c7e6 tempest-VolumesSnapshotTestJSON-1116693304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-014930e7-bede-407a-bb78-87036f05c7e6 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-014930e7-bede-407a-bb78-87036f05c7e6 tempest-VolumesSnapshotTestJSON-1116693304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:39 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:48:39 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:39 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-014930e7-bede-407a-bb78-87036f05c7e6 tempest-VolumesSnapshotTestJSON-1116693304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.257s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-014930e7-bede-407a-bb78-87036f05c7e6 tempest-VolumesSnapshotTestJSON-1116693304 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:48:39 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-014930e7-bede-407a-bb78-87036f05c7e6 tempest-VolumesSnapshotTestJSON-1116693304 None] Deleted volume successfully. Jul 24 09:48:39 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-014930e7-bede-407a-bb78-87036f05c7e6 tempest-VolumesSnapshotTestJSON-1116693304 None] Lock "cinder-e58afd74-d43a-44d9-b3ca-28d121d76081-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7498d2c8-abde-4bd3-9249-adc0ec417b17 tempest-VolumesGetTest-365468319 None] Acquiring lock "cinder-1726eafd-b7d3-4921-a7db-a63da2cf91ab-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7498d2c8-abde-4bd3-9249-adc0ec417b17 tempest-VolumesGetTest-365468319 None] Lock "cinder-1726eafd-b7d3-4921-a7db-a63da2cf91ab-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7498d2c8-abde-4bd3-9249-adc0ec417b17 tempest-VolumesGetTest-365468319 None] Acquiring lock "cinder-quobyte-1726eafd-b7d3-4921-a7db-a63da2cf91ab" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7498d2c8-abde-4bd3-9249-adc0ec417b17 tempest-VolumesGetTest-365468319 None] Lock "cinder-quobyte-1726eafd-b7d3-4921-a7db-a63da2cf91ab" acquired by "delete_volume" :: waited 0.020s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:40 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbef2341-9327-49c2-8a29-c33a7bb85689]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7498d2c8-abde-4bd3-9249-adc0ec417b17 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1726eafd-b7d3-4921-a7db-a63da2cf91ab {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:40 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1726eafd-b7d3-4921-a7db-a63da2cf91ab Jul 24 09:48:40 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:40 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7498d2c8-abde-4bd3-9249-adc0ec417b17 tempest-VolumesGetTest-365468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1726eafd-b7d3-4921-a7db-a63da2cf91ab" returned: 0 in 0.422s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7498d2c8-abde-4bd3-9249-adc0ec417b17 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1726eafd-b7d3-4921-a7db-a63da2cf91ab {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:40 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1726eafd-b7d3-4921-a7db-a63da2cf91ab Jul 24 09:48:40 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:40 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7498d2c8-abde-4bd3-9249-adc0ec417b17 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1726eafd-b7d3-4921-a7db-a63da2cf91ab" returned: 0 in 0.269s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7498d2c8-abde-4bd3-9249-adc0ec417b17 tempest-VolumesGetTest-365468319 None] Lock "cinder-quobyte-1726eafd-b7d3-4921-a7db-a63da2cf91ab" released by "delete_volume" :: held 0.734s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:40 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-7498d2c8-abde-4bd3-9249-adc0ec417b17 tempest-VolumesGetTest-365468319 None] Created reservations ['2a83b490-ebc4-4393-ac56-393c9cddb688', '452acf0e-1f31-4456-b3d0-7df21d4a8c26', 'd83ca393-4a46-4b74-901d-917d2221c4fd', 'c1da3d4f-939d-46c8-92d7-35c1433b4fed'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:48:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7498d2c8-abde-4bd3-9249-adc0ec417b17 tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7498d2c8-abde-4bd3-9249-adc0ec417b17 tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7498d2c8-abde-4bd3-9249-adc0ec417b17 tempest-VolumesGetTest-365468319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7498d2c8-abde-4bd3-9249-adc0ec417b17 tempest-VolumesGetTest-365468319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7498d2c8-abde-4bd3-9249-adc0ec417b17 tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7498d2c8-abde-4bd3-9249-adc0ec417b17 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:41 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:48:41 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:41 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7498d2c8-abde-4bd3-9249-adc0ec417b17 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.277s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-7498d2c8-abde-4bd3-9249-adc0ec417b17 tempest-VolumesGetTest-365468319 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:48:41 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-7498d2c8-abde-4bd3-9249-adc0ec417b17 tempest-VolumesGetTest-365468319 None] Deleted volume successfully. Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7498d2c8-abde-4bd3-9249-adc0ec417b17 tempest-VolumesGetTest-365468319 None] Lock "cinder-1726eafd-b7d3-4921-a7db-a63da2cf91ab-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Flow 'volume_create_manager' (acb53d3b-8f70-4feb-984a-96fc0f666509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450420e1-35de-414e-a792-baee678a3ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450420e1-35de-414e-a792-baee678a3ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1000339020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a92a99b-2e07-48bc-95c4-5a15b59d7129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e28ae48bd094bb3b3ac7c724e25d2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:48:42Z,use_quota=True,user_id='09715880c7804d5daeeb9b89629d5c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21e9b75-d9bc-437f-bd8d-9bdea8f173fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21e9b75-d9bc-437f-bd8d-9bdea8f173fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5589cb45-7260-4510-a55c-8d9a6bf29c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5589cb45-7260-4510-a55c-8d9a6bf29c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a92a99b-2e07-48bc-95c4-5a15b59d7129', 'volume_name': 'volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3ff213-af73-48f5-b339-57c48ae99108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3ff213-af73-48f5-b339-57c48ae99108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e45e43e-8627-4907-a8e9-2da11aaa8387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:41 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Volume 5a92a99b-2e07-48bc-95c4-5a15b59d7129: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129', 'volume_size': 1} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1000339020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a92a99b-2e07-48bc-95c4-5a15b59d7129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e28ae48bd094bb3b3ac7c724e25d2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:48:42Z,use_quota=True,user_id='09715880c7804d5daeeb9b89629d5c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Creating volume 5a92a99b-2e07-48bc-95c4-5a15b59d7129 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:48:41 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:48:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:41 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 1073741824 Jul 24 09:48:41 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:42 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 1073741824" returned: 0 in 0.531s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:42 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 Jul 24 09:48:42 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:42 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129" returned: 0 in 0.386s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:42 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:48:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:42 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e45e43e-8627-4907-a8e9-2da11aaa8387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:42 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40cf0e63-2991-4a33-a0b9-54c926361993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:42 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Volume volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 (5a92a99b-2e07-48bc-95c4-5a15b59d7129): created successfully Jul 24 09:48:42 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40cf0e63-2991-4a33-a0b9-54c926361993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:42 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Flow 'volume_create_manager' (acb53d3b-8f70-4feb-984a-96fc0f666509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:48:42 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-ec93f16e-5e3b-4297-b0b1-4199968f2b01 tempest-VolumesGetTest-365468319 None] Created volume successfully. Jul 24 09:48:44 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:48:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Flow 'volume_create_manager' (176772f9-82a4-4817-badb-7f084f614eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:48:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426a8447-8461-47f2-b491-588d553adc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426a8447-8461-47f2-b491-588d553adc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1083386051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=855f13db-f4c8-493d-a867-9833a8d908e2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2e28ae48bd094bb3b3ac7c724e25d2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5a92a99b-2e07-48bc-95c4-5a15b59d7129,status='creating',terminated_at=None,updated_at=2026-07-24T07:48:45Z,use_quota=True,user_id='09715880c7804d5daeeb9b89629d5c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63fee4df-73eb-4b3f-b1dc-5090ede73f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63fee4df-73eb-4b3f-b1dc-5090ede73f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90f7789e-65ca-41dc-b1b1-8347f191e06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90f7789e-65ca-41dc-b1b1-8347f191e06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '855f13db-f4c8-493d-a867-9833a8d908e2', 'volume_name': 'volume-855f13db-f4c8-493d-a867-9833a8d908e2', 'volume_size': 1, 'source_volid': '5a92a99b-2e07-48bc-95c4-5a15b59d7129', 'source_volstatus': 'available'}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c2e5e3-f31f-473f-93a6-14d704e004b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c2e5e3-f31f-473f-93a6-14d704e004b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa276ea-19b7-4834-b0a5-060c8e06e6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:44 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Volume 855f13db-f4c8-493d-a867-9833a8d908e2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-855f13db-f4c8-493d-a867-9833a8d908e2', 'volume_size': 1, 'source_volid': '5a92a99b-2e07-48bc-95c4-5a15b59d7129', 'source_volstatus': 'available'} Jul 24 09:48:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:44 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Cloning volume 5a92a99b-2e07-48bc-95c4-5a15b59d7129 to volume 855f13db-f4c8-493d-a867-9833a8d908e2 Jul 24 09:48:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Creating offline snapshot 08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a of volume 5a92a99b-2e07-48bc-95c4-5a15b59d7129 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:48:44 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[38786213-caca-4610-aaa2-a81fdf187e14]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:45 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 Jul 24 09:48:45 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:45 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129" returned: 0 in 0.416s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:45 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a 1G Jul 24 09:48:45 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:45 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a 1G" returned: 0 in 0.517s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:45 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a Jul 24 09:48:45 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:46 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a" returned: 0 in 0.315s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:46 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a is being set with open permissions: ugo+rw Jul 24 09:48:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:46 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a Jul 24 09:48:46 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:46 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:48:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Flow 'volume_create_manager' (1e6997c4-56e3-4bdc-95dc-1ad5c2c65275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:48:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b9855b-85cb-46c1-a8ef-392b24088053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b9855b-85cb-46c1-a8ef-392b24088053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-663070919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e68a495-fea4-435f-a07a-c5ea5e22cfd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3384cafd7c455a84866844afa569b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:48:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:48:46Z,use_quota=True,user_id='54d89f65f9ea439f8b28a6d91631f1c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba055ba-ec82-48b2-933e-f053b1201b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba055ba-ec82-48b2-933e-f053b1201b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01bd4b95-2dc6-414a-a432-850ff6296f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01bd4b95-2dc6-414a-a432-850ff6296f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e68a495-fea4-435f-a07a-c5ea5e22cfd2', 'volume_name': 'volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2', 'volume_size': 2}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:46 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c647e9d5-31b0-4db4-be07-0e57e10d4511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c647e9d5-31b0-4db4-be07-0e57e10d4511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dc107c-4605-4ff4-a6f6-80b2d249e7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:46 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Volume 4e68a495-fea4-435f-a07a-c5ea5e22cfd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2', 'volume_size': 2} Jul 24 09:48:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a" returned: 0 in 0.359s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:46 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.info Jul 24 09:48:46 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:46 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.info" returned: 0 in 0.257s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:46 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.info is being set with open permissions: ugo+rw Jul 24 09:48:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:46 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.info Jul 24 09:48:46 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:47 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.info" returned: 0 in 0.239s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Acquiring lock "cinder-quobyte-855f13db-f4c8-493d-a867-9833a8d908e2" by "_copy_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Lock "cinder-quobyte-855f13db-f4c8-493d-a867-9833a8d908e2" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] snapshot: 08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a, volume: 855f13db-f4c8-493d-a867-9833a8d908e2, {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 09:48:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:47 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e513419-8fe6-402e-81b2-3c9d158e64df]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:47 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a Jul 24 09:48:47 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:47 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a" returned: 0 in 0.347s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:48:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 09:48:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Creating direct copy from snapshot {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 09:48:47 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5efd0aa-59ee-4a8c-a73e-fd2b7d620846]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:47 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 Jul 24 09:48:47 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:47 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129" returned: 0 in 0.358s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:47 devstack cinder-volume[88488]: DEBUG cinder.utils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Path /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-855f13db-f4c8-493d-a867-9833a8d908e2 not found in is_blk_device check {{(pid=88488) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 09:48:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-855f13db-f4c8-493d-a867-9833a8d908e2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:47 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-855f13db-f4c8-493d-a867-9833a8d908e2 Jul 24 09:48:47 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:51 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-855f13db-f4c8-493d-a867-9833a8d908e2" returned: 0 in 4.033s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:51 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a4241a-fb62-4156-8dc3-4b4e51e1c3f2]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:51 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 Jul 24 09:48:51 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:52 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129" returned: 0 in 0.532s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:52 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129, size 1024.00 MB, duration 4.03 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-855f13db-f4c8-493d-a867-9833a8d908e2 {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:48:52 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Converted 1024.00 MB image at 253.80 MB/s Jul 24 09:48:52 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-855f13db-f4c8-493d-a867-9833a8d908e2 is being set with open permissions: ugo+rw Jul 24 09:48:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-855f13db-f4c8-493d-a867-9833a8d908e2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:52 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-855f13db-f4c8-493d-a867-9833a8d908e2 Jul 24 09:48:52 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:52 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-855f13db-f4c8-493d-a867-9833a8d908e2" returned: 0 in 0.244s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Lock "cinder-quobyte-855f13db-f4c8-493d-a867-9833a8d908e2" released by "_copy_volume_from_snapshot" :: held 5.585s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Acquiring lock "cinder-quobyte-08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Lock "cinder-quobyte-08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Deleting offline snapshot 08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a of volume 5a92a99b-2e07-48bc-95c4-5a15b59d7129 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:48:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] snapshot_file for this snap is: volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:48:52 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[57edcca6-9d9c-485e-92b2-44dd012bd997]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:52 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a Jul 24 09:48:52 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:53 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a" returned: 0 in 0.365s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:48:53 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc96f35d-165f-4e24-aba8-8c3d65802aae]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:53 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 Jul 24 09:48:53 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:53 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129" returned: 0 in 0.369s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:53 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a Jul 24 09:48:53 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:53 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a" returned: 0 in 0.333s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:53 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a Jul 24 09:48:53 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:54 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129.08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a" returned: 0 in 0.250s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Lock "cinder-quobyte-08e00300-f1d9-4c9a-bbd6-5e5d8d4bb73a" released by "_delete_snapshot" :: held 1.409s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.288s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.618s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-663070919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e68a495-fea4-435f-a07a-c5ea5e22cfd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3384cafd7c455a84866844afa569b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:48:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:48:46Z,use_quota=True,user_id='54d89f65f9ea439f8b28a6d91631f1c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Creating volume 4e68a495-fea4-435f-a07a-c5ea5e22cfd2 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:48:54 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2 2147483648 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:54 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2 2147483648 Jul 24 09:48:54 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa276ea-19b7-4834-b0a5-060c8e06e6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-855f13db-f4c8-493d-a867-9833a8d908e2', 'volume_size': 1, 'source_volid': '5a92a99b-2e07-48bc-95c4-5a15b59d7129', 'source_volstatus': 'available'}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef88c851-072c-4b9c-be5d-4dddf50abec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:54 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Volume volume-855f13db-f4c8-493d-a867-9833a8d908e2 (855f13db-f4c8-493d-a867-9833a8d908e2): created successfully Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef88c851-072c-4b9c-be5d-4dddf50abec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Flow 'volume_create_manager' (176772f9-82a4-4817-badb-7f084f614eb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:48:54 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-93b76873-fbdf-454f-b8f5-bed0b068b2e8 tempest-VolumesGetTest-365468319 None] Created volume successfully. Jul 24 09:48:54 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2 2147483648" returned: 0 in 0.494s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:54 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2 Jul 24 09:48:54 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:54 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2" returned: 0 in 0.247s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dc107c-4605-4ff4-a6f6-80b2d249e7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2', 'volume_size': 2}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb43dfe9-a041-4fc5-99ea-ae6f08980163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:54 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Volume volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2 (4e68a495-fea4-435f-a07a-c5ea5e22cfd2): created successfully Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb43dfe9-a041-4fc5-99ea-ae6f08980163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:54 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Flow 'volume_create_manager' (1e6997c4-56e3-4bdc-95dc-1ad5c2c65275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:48:54 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d94680e2-3961-46a2-b1de-c40ebcdaee2c tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Created volume successfully. Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Flow 'volume_create_manager' (2258c717-f804-470c-811d-59f109b33b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b4ec74-3a42-42ba-b53f-b0c6bd9a5aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b4ec74-3a42-42ba-b53f-b0c6bd9a5aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:48:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1573069152',display_name='tempest-VolumesGetTest-Volume-235011009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d1cfc0-4015-42f3-bf01-7af2536f29ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e28ae48bd094bb3b3ac7c724e25d2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:48:55Z,use_quota=True,user_id='09715880c7804d5daeeb9b89629d5c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4a4d37-9b0c-4fcd-b9b0-491d0370fef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4a4d37-9b0c-4fcd-b9b0-491d0370fef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21504c74-0bc5-434a-9f0e-42040952fac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21504c74-0bc5-434a-9f0e-42040952fac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92d1cfc0-4015-42f3-bf01-7af2536f29ec', 'volume_name': 'volume-92d1cfc0-4015-42f3-bf01-7af2536f29ec', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb7b7ae-a51b-4a28-9e7c-01fbf5c46da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb7b7ae-a51b-4a28-9e7c-01fbf5c46da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b40656-30e3-42cc-b9c9-9f7d2e1bab2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:55 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Volume 92d1cfc0-4015-42f3-bf01-7af2536f29ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92d1cfc0-4015-42f3-bf01-7af2536f29ec', 'volume_size': 1} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:48:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1573069152',display_name='tempest-VolumesGetTest-Volume-235011009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d1cfc0-4015-42f3-bf01-7af2536f29ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e28ae48bd094bb3b3ac7c724e25d2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:48:55Z,use_quota=True,user_id='09715880c7804d5daeeb9b89629d5c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Creating volume 92d1cfc0-4015-42f3-bf01-7af2536f29ec {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:48:55 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-92d1cfc0-4015-42f3-bf01-7af2536f29ec 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:55 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-92d1cfc0-4015-42f3-bf01-7af2536f29ec 1073741824 Jul 24 09:48:55 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9771f3fb-d982-4291-845e-7fe32bc4543e tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:55 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-92d1cfc0-4015-42f3-bf01-7af2536f29ec 1073741824" returned: 0 in 0.428s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-92d1cfc0-4015-42f3-bf01-7af2536f29ec {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:55 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-92d1cfc0-4015-42f3-bf01-7af2536f29ec Jul 24 09:48:55 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:55 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-92d1cfc0-4015-42f3-bf01-7af2536f29ec" returned: 0 in 0.241s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9771f3fb-d982-4291-845e-7fe32bc4543e tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.530s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b40656-30e3-42cc-b9c9-9f7d2e1bab2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92d1cfc0-4015-42f3-bf01-7af2536f29ec', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa5de7c-47f5-4547-8866-434de7644ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-9771f3fb-d982-4291-845e-7fe32bc4543e tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Creating offline snapshot 980ae1da-6e2b-413a-896f-587c95dfa42e of volume 4e68a495-fea4-435f-a07a-c5ea5e22cfd2 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:48:55 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Volume volume-92d1cfc0-4015-42f3-bf01-7af2536f29ec (92d1cfc0-4015-42f3-bf01-7af2536f29ec): created successfully Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa5de7c-47f5-4547-8866-434de7644ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Flow 'volume_create_manager' (2258c717-f804-470c-811d-59f109b33b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cbea70-ef1d-43fd-a548-3097b9ba7f36]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9771f3fb-d982-4291-845e-7fe32bc4543e tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:55 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-22d48cc4-32d0-40eb-89bc-4829d198356e tempest-VolumesGetTest-365468319 None] Created volume successfully. Jul 24 09:48:56 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2 Jul 24 09:48:56 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0132dec3-19a3-4bd3-8980-c1ebd64c0a01 tempest-VolumesGetTest-365468319 None] Acquiring lock "cinder-92d1cfc0-4015-42f3-bf01-7af2536f29ec-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0132dec3-19a3-4bd3-8980-c1ebd64c0a01 tempest-VolumesGetTest-365468319 None] Lock "cinder-92d1cfc0-4015-42f3-bf01-7af2536f29ec-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0132dec3-19a3-4bd3-8980-c1ebd64c0a01 tempest-VolumesGetTest-365468319 None] Acquiring lock "cinder-quobyte-92d1cfc0-4015-42f3-bf01-7af2536f29ec" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0132dec3-19a3-4bd3-8980-c1ebd64c0a01 tempest-VolumesGetTest-365468319 None] Lock "cinder-quobyte-92d1cfc0-4015-42f3-bf01-7af2536f29ec" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:56 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9771f3fb-d982-4291-845e-7fe32bc4543e tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2" returned: 0 in 0.389s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9771f3fb-d982-4291-845e-7fe32bc4543e tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.980ae1da-6e2b-413a-896f-587c95dfa42e 2G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:56 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0117c5-fb86-40e6-b458-a32852fe3cab]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0132dec3-19a3-4bd3-8980-c1ebd64c0a01 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-92d1cfc0-4015-42f3-bf01-7af2536f29ec {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:56 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.980ae1da-6e2b-413a-896f-587c95dfa42e 2G Jul 24 09:48:56 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:56 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-92d1cfc0-4015-42f3-bf01-7af2536f29ec Jul 24 09:48:56 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:56 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0132dec3-19a3-4bd3-8980-c1ebd64c0a01 tempest-VolumesGetTest-365468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-92d1cfc0-4015-42f3-bf01-7af2536f29ec" returned: 0 in 0.361s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0132dec3-19a3-4bd3-8980-c1ebd64c0a01 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-92d1cfc0-4015-42f3-bf01-7af2536f29ec {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:56 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9771f3fb-d982-4291-845e-7fe32bc4543e tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.980ae1da-6e2b-413a-896f-587c95dfa42e 2G" returned: 0 in 0.385s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9771f3fb-d982-4291-845e-7fe32bc4543e tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.980ae1da-6e2b-413a-896f-587c95dfa42e {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:56 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-92d1cfc0-4015-42f3-bf01-7af2536f29ec Jul 24 09:48:56 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:56 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.980ae1da-6e2b-413a-896f-587c95dfa42e Jul 24 09:48:56 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:56 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0132dec3-19a3-4bd3-8980-c1ebd64c0a01 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-92d1cfc0-4015-42f3-bf01-7af2536f29ec" returned: 0 in 0.239s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0132dec3-19a3-4bd3-8980-c1ebd64c0a01 tempest-VolumesGetTest-365468319 None] Lock "cinder-quobyte-92d1cfc0-4015-42f3-bf01-7af2536f29ec" released by "delete_volume" :: held 0.654s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:56 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:56 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-0132dec3-19a3-4bd3-8980-c1ebd64c0a01 tempest-VolumesGetTest-365468319 None] Created reservations ['1e4608ec-dc9e-405f-ba13-083ea4fb84d9', 'bdafbe5e-315e-4c30-a4d4-ad19a316afda', 'fd7ac47c-1f99-48e9-9690-78fb52c4950c', '537fee58-a00e-4d58-9d69-e2dfeec1f7e6'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:48:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9771f3fb-d982-4291-845e-7fe32bc4543e tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.980ae1da-6e2b-413a-896f-587c95dfa42e" returned: 0 in 0.295s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:56 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-9771f3fb-d982-4291-845e-7fe32bc4543e tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.980ae1da-6e2b-413a-896f-587c95dfa42e is being set with open permissions: ugo+rw Jul 24 09:48:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9771f3fb-d982-4291-845e-7fe32bc4543e tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.980ae1da-6e2b-413a-896f-587c95dfa42e {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:57 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.980ae1da-6e2b-413a-896f-587c95dfa42e Jul 24 09:48:57 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0132dec3-19a3-4bd3-8980-c1ebd64c0a01 tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0132dec3-19a3-4bd3-8980-c1ebd64c0a01 tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0132dec3-19a3-4bd3-8980-c1ebd64c0a01 tempest-VolumesGetTest-365468319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0132dec3-19a3-4bd3-8980-c1ebd64c0a01 tempest-VolumesGetTest-365468319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0132dec3-19a3-4bd3-8980-c1ebd64c0a01 tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0132dec3-19a3-4bd3-8980-c1ebd64c0a01 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:57 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:48:57 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:57 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9771f3fb-d982-4291-845e-7fe32bc4543e tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.980ae1da-6e2b-413a-896f-587c95dfa42e" returned: 0 in 0.240s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9771f3fb-d982-4291-845e-7fe32bc4543e tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:57 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.info Jul 24 09:48:57 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:57 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0132dec3-19a3-4bd3-8980-c1ebd64c0a01 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.245s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-0132dec3-19a3-4bd3-8980-c1ebd64c0a01 tempest-VolumesGetTest-365468319 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:48:57 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-0132dec3-19a3-4bd3-8980-c1ebd64c0a01 tempest-VolumesGetTest-365468319 None] Deleted volume successfully. Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0132dec3-19a3-4bd3-8980-c1ebd64c0a01 tempest-VolumesGetTest-365468319 None] Lock "cinder-92d1cfc0-4015-42f3-bf01-7af2536f29ec-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7cd1d468-d94a-49a7-9ac9-f7eeacae719c tempest-VolumesGetTest-365468319 None] Acquiring lock "cinder-855f13db-f4c8-493d-a867-9833a8d908e2-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7cd1d468-d94a-49a7-9ac9-f7eeacae719c tempest-VolumesGetTest-365468319 None] Lock "cinder-855f13db-f4c8-493d-a867-9833a8d908e2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7cd1d468-d94a-49a7-9ac9-f7eeacae719c tempest-VolumesGetTest-365468319 None] Acquiring lock "cinder-quobyte-855f13db-f4c8-493d-a867-9833a8d908e2" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7cd1d468-d94a-49a7-9ac9-f7eeacae719c tempest-VolumesGetTest-365468319 None] Lock "cinder-quobyte-855f13db-f4c8-493d-a867-9833a8d908e2" acquired by "delete_volume" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:57 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9771f3fb-d982-4291-845e-7fe32bc4543e tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.info" returned: 0 in 0.273s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:57 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-9771f3fb-d982-4291-845e-7fe32bc4543e tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.info is being set with open permissions: ugo+rw Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9771f3fb-d982-4291-845e-7fe32bc4543e tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[563b2ef6-53f0-4718-8544-f705f996a4f0]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7cd1d468-d94a-49a7-9ac9-f7eeacae719c tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-855f13db-f4c8-493d-a867-9833a8d908e2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:57 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.info Jul 24 09:48:57 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:57 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-855f13db-f4c8-493d-a867-9833a8d908e2 Jul 24 09:48:57 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:57 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9771f3fb-d982-4291-845e-7fe32bc4543e tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.info" returned: 0 in 0.233s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9771f3fb-d982-4291-845e-7fe32bc4543e tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.928s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:57 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-9771f3fb-d982-4291-845e-7fe32bc4543e tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Create snapshot completed successfully Jul 24 09:48:57 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7cd1d468-d94a-49a7-9ac9-f7eeacae719c tempest-VolumesGetTest-365468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-855f13db-f4c8-493d-a867-9833a8d908e2" returned: 0 in 0.363s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7cd1d468-d94a-49a7-9ac9-f7eeacae719c tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-855f13db-f4c8-493d-a867-9833a8d908e2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:57 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-855f13db-f4c8-493d-a867-9833a8d908e2 Jul 24 09:48:57 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:58 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7cd1d468-d94a-49a7-9ac9-f7eeacae719c tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-855f13db-f4c8-493d-a867-9833a8d908e2" returned: 0 in 0.239s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7cd1d468-d94a-49a7-9ac9-f7eeacae719c tempest-VolumesGetTest-365468319 None] Lock "cinder-quobyte-855f13db-f4c8-493d-a867-9833a8d908e2" released by "delete_volume" :: held 0.646s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-7cd1d468-d94a-49a7-9ac9-f7eeacae719c tempest-VolumesGetTest-365468319 None] Created reservations ['72e1aef6-b95f-44ee-80eb-01dda15dce66', '701af467-dbbd-403b-a625-369f49f07bb4', '1f3aa5cb-bec6-49ae-a471-8a24e655642b', 'b9a9fe53-530c-46e1-b013-0cdd4cda148d'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7cd1d468-d94a-49a7-9ac9-f7eeacae719c tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7cd1d468-d94a-49a7-9ac9-f7eeacae719c tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7cd1d468-d94a-49a7-9ac9-f7eeacae719c tempest-VolumesGetTest-365468319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7cd1d468-d94a-49a7-9ac9-f7eeacae719c tempest-VolumesGetTest-365468319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7cd1d468-d94a-49a7-9ac9-f7eeacae719c tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7cd1d468-d94a-49a7-9ac9-f7eeacae719c tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:58 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:48:58 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:58 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7cd1d468-d94a-49a7-9ac9-f7eeacae719c tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.236s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-7cd1d468-d94a-49a7-9ac9-f7eeacae719c tempest-VolumesGetTest-365468319 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:48:58 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-7cd1d468-d94a-49a7-9ac9-f7eeacae719c tempest-VolumesGetTest-365468319 None] Deleted volume successfully. Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7cd1d468-d94a-49a7-9ac9-f7eeacae719c tempest-VolumesGetTest-365468319 None] Lock "cinder-855f13db-f4c8-493d-a867-9833a8d908e2-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Acquiring lock "cinder-980ae1da-6e2b-413a-896f-587c95dfa42e-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Lock "cinder-980ae1da-6e2b-413a-896f-587c95dfa42e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Acquiring lock "cinder-quobyte-4e68a495-fea4-435f-a07a-c5ea5e22cfd2" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Lock "cinder-quobyte-4e68a495-fea4-435f-a07a-c5ea5e22cfd2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Acquiring lock "cinder-quobyte-980ae1da-6e2b-413a-896f-587c95dfa42e" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Lock "cinder-quobyte-980ae1da-6e2b-413a-896f-587c95dfa42e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Deleting offline snapshot 980ae1da-6e2b-413a-896f-587c95dfa42e of volume 4e68a495-fea4-435f-a07a-c5ea5e22cfd2 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] snapshot_file for this snap is: volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.980ae1da-6e2b-413a-896f-587c95dfa42e {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d688ac2-57b8-4f4a-8bc8-aa8aa0968240]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.980ae1da-6e2b-413a-896f-587c95dfa42e {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-66d4041a-27cc-4de9-9966-25bc6e568094 tempest-VolumesGetTest-365468319 None] Acquiring lock "cinder-5a92a99b-2e07-48bc-95c4-5a15b59d7129-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-66d4041a-27cc-4de9-9966-25bc6e568094 tempest-VolumesGetTest-365468319 None] Lock "cinder-5a92a99b-2e07-48bc-95c4-5a15b59d7129-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-66d4041a-27cc-4de9-9966-25bc6e568094 tempest-VolumesGetTest-365468319 None] Acquiring lock "cinder-quobyte-5a92a99b-2e07-48bc-95c4-5a15b59d7129" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-66d4041a-27cc-4de9-9966-25bc6e568094 tempest-VolumesGetTest-365468319 None] Lock "cinder-quobyte-5a92a99b-2e07-48bc-95c4-5a15b59d7129" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:48:58 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.980ae1da-6e2b-413a-896f-587c95dfa42e Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6a6f21-675d-4ddd-b371-8e18e5c28cae]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-66d4041a-27cc-4de9-9966-25bc6e568094 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:58 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:58 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 Jul 24 09:48:58 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:59 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.980ae1da-6e2b-413a-896f-587c95dfa42e" returned: 0 in 0.377s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2ce35a-f8b6-4624-9604-37b2955f72e7]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:59 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2 Jul 24 09:48:59 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:59 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-66d4041a-27cc-4de9-9966-25bc6e568094 tempest-VolumesGetTest-365468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129" returned: 0 in 0.381s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-66d4041a-27cc-4de9-9966-25bc6e568094 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:59 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129 Jul 24 09:48:59 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:59 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2" returned: 0 in 0.382s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.980ae1da-6e2b-413a-896f-587c95dfa42e {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:59 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.980ae1da-6e2b-413a-896f-587c95dfa42e Jul 24 09:48:59 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:59 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-66d4041a-27cc-4de9-9966-25bc6e568094 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5a92a99b-2e07-48bc-95c4-5a15b59d7129" returned: 0 in 0.257s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-66d4041a-27cc-4de9-9966-25bc6e568094 tempest-VolumesGetTest-365468319 None] Lock "cinder-quobyte-5a92a99b-2e07-48bc-95c4-5a15b59d7129" released by "delete_volume" :: held 0.733s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-66d4041a-27cc-4de9-9966-25bc6e568094 tempest-VolumesGetTest-365468319 None] Created reservations ['48351347-61fc-49ff-890c-5c0929c4a29f', 'b0cae452-3203-4a66-ba84-69fd29cb3d14', '7682d5cb-8adc-4656-85c3-da58fb203296', '2784838e-57a9-475b-8454-53f664f991e0'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-66d4041a-27cc-4de9-9966-25bc6e568094 tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-66d4041a-27cc-4de9-9966-25bc6e568094 tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-66d4041a-27cc-4de9-9966-25bc6e568094 tempest-VolumesGetTest-365468319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-66d4041a-27cc-4de9-9966-25bc6e568094 tempest-VolumesGetTest-365468319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-66d4041a-27cc-4de9-9966-25bc6e568094 tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-66d4041a-27cc-4de9-9966-25bc6e568094 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:59 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:48:59 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:59 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.980ae1da-6e2b-413a-896f-587c95dfa42e" returned: 0 in 0.375s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.980ae1da-6e2b-413a-896f-587c95dfa42e {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:48:59 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.980ae1da-6e2b-413a-896f-587c95dfa42e Jul 24 09:48:59 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:48:59 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-66d4041a-27cc-4de9-9966-25bc6e568094 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.278s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-66d4041a-27cc-4de9-9966-25bc6e568094 tempest-VolumesGetTest-365468319 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:48:59 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-66d4041a-27cc-4de9-9966-25bc6e568094 tempest-VolumesGetTest-365468319 None] Deleted volume successfully. Jul 24 09:48:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-66d4041a-27cc-4de9-9966-25bc6e568094 tempest-VolumesGetTest-365468319 None] Lock "cinder-5a92a99b-2e07-48bc-95c4-5a15b59d7129-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:00 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2.980ae1da-6e2b-413a-896f-587c95dfa42e" returned: 0 in 0.265s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Lock "cinder-quobyte-980ae1da-6e2b-413a-896f-587c95dfa42e" released by "_delete_snapshot" :: held 1.500s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Lock "cinder-quobyte-4e68a495-fea4-435f-a07a-c5ea5e22cfd2" released by "delete_snapshot" :: held 1.524s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:00 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Created reservations ['0a32b2f6-48ed-46fb-af0b-cff645c93949', '08df2f3a-dde7-4695-b77f-565dd31bb0db', 'a1578d9b-60dd-4a2f-ac25-495e7aedbee5', '5d3cd3dd-7b39-450d-9897-b069a67eea81'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:49:00 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Delete snapshot completed successfully. Jul 24 09:49:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-38168cc5-69c3-4e30-8238-8a4915a2cea2 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Lock "cinder-980ae1da-6e2b-413a-896f-587c95dfa42e-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:00 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:49:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Flow 'volume_create_manager' (36fb8191-6f6f-42de-ae54-f0955ab2c816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:49:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d6b1e6-6c34-41c8-896f-bc68986b38b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d6b1e6-6c34-41c8-896f-bc68986b38b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-269826464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7bab2e0-6fdc-479d-a128-58b43a7ce52f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2e28ae48bd094bb3b3ac7c724e25d2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:49:01Z,use_quota=True,user_id='09715880c7804d5daeeb9b89629d5c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf61ea0-8cc1-4940-b4d4-fee46cc20f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf61ea0-8cc1-4940-b4d4-fee46cc20f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47161dba-aa2a-4984-8b13-0bb53cf1e616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:00 devstack cinder-volume[88488]: DEBUG cinder.image.glance [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Creating Keystone auth plugin from conf {{(pid=88488) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 09:49:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1ec654e7-7604-4b7e-926e-d9370550a655 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Acquiring lock "cinder-4e68a495-fea4-435f-a07a-c5ea5e22cfd2-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1ec654e7-7604-4b7e-926e-d9370550a655 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Lock "cinder-4e68a495-fea4-435f-a07a-c5ea5e22cfd2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1ec654e7-7604-4b7e-926e-d9370550a655 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Acquiring lock "cinder-quobyte-4e68a495-fea4-435f-a07a-c5ea5e22cfd2" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1ec654e7-7604-4b7e-926e-d9370550a655 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Lock "cinder-quobyte-4e68a495-fea4-435f-a07a-c5ea5e22cfd2" acquired by "delete_volume" :: waited 0.013s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:00 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9220ac48-688a-43fe-abd2-2d0074b27061]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:49:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1ec654e7-7604-4b7e-926e-d9370550a655 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:01 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2 Jul 24 09:49:01 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47161dba-aa2a-4984-8b13-0bb53cf1e616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f7bab2e0-6fdc-479d-a128-58b43a7ce52f', 'volume_name': 'volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f', 'volume_size': 1, 'image_id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3181d69d4e349c08df0ab05faa1a57c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'created_at': datetime.datetime(2026, 7, 24, 7, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b4698f-a6a3-4577-a0c7-2f2f41a4fb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b4698f-a6a3-4577-a0c7-2f2f41a4fb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a543c8-e954-4c24-9a1b-551ee4f512d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:01 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Volume f7bab2e0-6fdc-479d-a128-58b43a7ce52f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f', 'volume_size': 1, 'image_id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3181d69d4e349c08df0ab05faa1a57c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'created_at': datetime.datetime(2026, 7, 24, 7, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Trying to clone f7bab2e0-6fdc-479d-a128-58b43a7ce52f from image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc at location (None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}]). {{(pid=88488) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 09:49:01 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1ec654e7-7604-4b7e-926e-d9370550a655 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2" returned: 0 in 0.391s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1ec654e7-7604-4b7e-926e-d9370550a655 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:01 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2 Jul 24 09:49:01 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_jtvnzdb8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 09:49:01 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Image download 20.69 MB at 20.69 MB/s Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9aa5bc-a875-4999-9477-55588ad92465]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_jtvnzdb8devstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:01 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_jtvnzdb8devstack@QuobyteHD Jul 24 09:49:01 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:01 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1ec654e7-7604-4b7e-926e-d9370550a655 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-4e68a495-fea4-435f-a07a-c5ea5e22cfd2" returned: 0 in 0.271s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1ec654e7-7604-4b7e-926e-d9370550a655 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Lock "cinder-quobyte-4e68a495-fea4-435f-a07a-c5ea5e22cfd2" released by "delete_volume" :: held 0.727s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-1ec654e7-7604-4b7e-926e-d9370550a655 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Created reservations ['2ac72530-a4e4-4171-bc16-fe542787df60', '938a8a65-9c46-47e1-887b-67adad63d48e', '9c782377-549a-44ac-b319-7f525a2bc0fd', '073f1b5b-72a3-4089-a48f-509ed20769c3'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1ec654e7-7604-4b7e-926e-d9370550a655 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1ec654e7-7604-4b7e-926e-d9370550a655 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1ec654e7-7604-4b7e-926e-d9370550a655 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1ec654e7-7604-4b7e-926e-d9370550a655 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1ec654e7-7604-4b7e-926e-d9370550a655 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1ec654e7-7604-4b7e-926e-d9370550a655 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:01 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:49:01 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:01 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_jtvnzdb8devstack@QuobyteHD" returned: 0 in 0.349s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Temporary image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc is fetched for user 09715880c7804d5daeeb9b89629d5c03. {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[700df620-3e37-4777-ab53-d3444125f886]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_jtvnzdb8devstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:01 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1ec654e7-7604-4b7e-926e-d9370550a655 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.253s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-1ec654e7-7604-4b7e-926e-d9370550a655 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:49:01 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-1ec654e7-7604-4b7e-926e-d9370550a655 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Deleted volume successfully. Jul 24 09:49:01 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_jtvnzdb8devstack@QuobyteHD Jul 24 09:49:01 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1ec654e7-7604-4b7e-926e-d9370550a655 tempest-VolumesSnapshotNegativeTestJSON-1606471325 None] Lock "cinder-4e68a495-fea4-435f-a07a-c5ea5e22cfd2-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:02 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_jtvnzdb8devstack@QuobyteHD" returned: 0 in 0.355s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-269826464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7bab2e0-6fdc-479d-a128-58b43a7ce52f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2e28ae48bd094bb3b3ac7c724e25d2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:49:01Z,use_quota=True,user_id='09715880c7804d5daeeb9b89629d5c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:49:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Creating volume f7bab2e0-6fdc-479d-a128-58b43a7ce52f {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:49:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:49:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:49:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:49:02 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:49:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:02 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f 1073741824 Jul 24 09:49:02 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:02 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f 1073741824" returned: 0 in 0.457s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:02 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f Jul 24 09:49:02 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:02 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f" returned: 0 in 0.263s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:49:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:03 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Attempting download of ce0135c3-cdf3-4327-98f4-fcc81dc66bbc ((None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}])) to volume f7bab2e0-6fdc-479d-a128-58b43a7ce52f. {{(pid=88488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 09:49:03 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b6d1c9-86c4-4587-8b40-f4885b0bc434]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:49:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_5ua7z4t9 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:03 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_5ua7z4t9 Jul 24 09:49:03 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:03 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_5ua7z4t9" returned: 0 in 0.351s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_5ua7z4t9 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:03 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_5ua7z4t9 Jul 24 09:49:03 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:03 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_5ua7z4t9" returned: 1 in 0.340s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_5ua7z4t9' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:49:03 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a82f82-52da-474a-98d1-a3b45c282891]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:49:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_jtvnzdb8devstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:03 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_jtvnzdb8devstack@QuobyteHD Jul 24 09:49:03 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:04 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_jtvnzdb8devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:04 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] ce0135c3-cdf3-4327-98f4-fcc81dc66bbc was qcow2, converting to qcow2 {{(pid=88488) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 09:49:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_jtvnzdb8devstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:04 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_jtvnzdb8devstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f Jul 24 09:49:04 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:05 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_jtvnzdb8devstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f" returned: 0 in 1.776s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:05 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ce0135c3-cdf3-4327-98f4-fcc81dc66bbc_jtvnzdb8devstack@QuobyteHD, size 112.00 MB, duration 1.78 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:49:05 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Converted 112.00 MB image at 63.03 MB/s Jul 24 09:49:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:05 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f 1G Jul 24 09:49:05 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:06 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f 1G" returned: 0 in 0.323s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:06 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Downloaded image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc ((None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}])) to volume f7bab2e0-6fdc-479d-a128-58b43a7ce52f successfully. {{(pid=88488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 09:49:06 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Temporary image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc for user 09715880c7804d5daeeb9b89629d5c03 is deleted. {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 09:49:06 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Marking volume f7bab2e0-6fdc-479d-a128-58b43a7ce52f as bootable. {{(pid=88488) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 09:49:06 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Copying metadata from image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc to f7bab2e0-6fdc-479d-a128-58b43a7ce52f. {{(pid=88488) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 09:49:06 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Creating volume glance metadata for volume f7bab2e0-6fdc-479d-a128-58b43a7ce52f backed by image ce0135c3-cdf3-4327-98f4-fcc81dc66bbc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88488) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 09:49:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a543c8-e954-4c24-9a1b-551ee4f512d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f', 'volume_size': 1, 'image_id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3181d69d4e349c08df0ab05faa1a57c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce0135c3-cdf3-4327-98f4-fcc81dc66bbc', 'created_at': datetime.datetime(2026, 7, 24, 7, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce0135c3-cdf3-4327-98f4-fcc81dc66bbc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (212a638b-0540-4bcc-8016-9c59b46f167d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:06 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Volume volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f (f7bab2e0-6fdc-479d-a128-58b43a7ce52f): created successfully Jul 24 09:49:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (212a638b-0540-4bcc-8016-9c59b46f167d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Flow 'volume_create_manager' (36fb8191-6f6f-42de-ae54-f0955ab2c816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:49:06 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b180009b-7b2a-4cf0-b5c3-af095622f8af tempest-VolumesGetTest-365468319 None] Created volume successfully. Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Flow 'volume_create_manager' (9fc44f16-aa98-42c0-9bef-316d74554a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3f4c62-12ae-4ba8-94c8-c6ec606e89d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3f4c62-12ae-4ba8-94c8-c6ec606e89d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:49:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-671486816',display_name='tempest-VolumesGetTest-Volume-1392950160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa036d94-7012-44dd-89a9-86ec415a3af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e28ae48bd094bb3b3ac7c724e25d2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:49:08Z,use_quota=True,user_id='09715880c7804d5daeeb9b89629d5c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b6742b-1808-4979-9286-6eadaa332f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b6742b-1808-4979-9286-6eadaa332f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e9f57c-0716-48b2-ad22-58c86b3ddf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e9f57c-0716-48b2-ad22-58c86b3ddf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa036d94-7012-44dd-89a9-86ec415a3af1', 'volume_name': 'volume-fa036d94-7012-44dd-89a9-86ec415a3af1', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1486ac94-28e6-48d4-aa07-303c54957d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1486ac94-28e6-48d4-aa07-303c54957d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9bc6c38-6df1-45dc-a9fe-df3bdf0fe5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:07 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Volume fa036d94-7012-44dd-89a9-86ec415a3af1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa036d94-7012-44dd-89a9-86ec415a3af1', 'volume_size': 1} Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:49:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-671486816',display_name='tempest-VolumesGetTest-Volume-1392950160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa036d94-7012-44dd-89a9-86ec415a3af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e28ae48bd094bb3b3ac7c724e25d2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:49:08Z,use_quota=True,user_id='09715880c7804d5daeeb9b89629d5c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Creating volume fa036d94-7012-44dd-89a9-86ec415a3af1 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:49:07 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:49:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa036d94-7012-44dd-89a9-86ec415a3af1 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:07 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa036d94-7012-44dd-89a9-86ec415a3af1 1073741824 Jul 24 09:49:07 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:08 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa036d94-7012-44dd-89a9-86ec415a3af1 1073741824" returned: 0 in 0.429s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa036d94-7012-44dd-89a9-86ec415a3af1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:08 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa036d94-7012-44dd-89a9-86ec415a3af1 Jul 24 09:49:08 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:08 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa036d94-7012-44dd-89a9-86ec415a3af1" returned: 0 in 0.354s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:49:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9bc6c38-6df1-45dc-a9fe-df3bdf0fe5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa036d94-7012-44dd-89a9-86ec415a3af1', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb597355-6524-4e60-8bcb-89dc3de4d1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:08 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Volume volume-fa036d94-7012-44dd-89a9-86ec415a3af1 (fa036d94-7012-44dd-89a9-86ec415a3af1): created successfully Jul 24 09:49:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb597355-6524-4e60-8bcb-89dc3de4d1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Flow 'volume_create_manager' (9fc44f16-aa98-42c0-9bef-316d74554a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:49:08 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c2a69477-f514-485d-8b73-10a80362ba7b tempest-VolumesGetTest-365468319 None] Created volume successfully. Jul 24 09:49:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-28a40cb8-a2d4-4c68-8f8c-b80d772d1f71 tempest-VolumesGetTest-365468319 None] Acquiring lock "cinder-fa036d94-7012-44dd-89a9-86ec415a3af1-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-28a40cb8-a2d4-4c68-8f8c-b80d772d1f71 tempest-VolumesGetTest-365468319 None] Lock "cinder-fa036d94-7012-44dd-89a9-86ec415a3af1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-28a40cb8-a2d4-4c68-8f8c-b80d772d1f71 tempest-VolumesGetTest-365468319 None] Acquiring lock "cinder-quobyte-fa036d94-7012-44dd-89a9-86ec415a3af1" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-28a40cb8-a2d4-4c68-8f8c-b80d772d1f71 tempest-VolumesGetTest-365468319 None] Lock "cinder-quobyte-fa036d94-7012-44dd-89a9-86ec415a3af1" acquired by "delete_volume" :: waited 0.065s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:10 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5122ed-a2e9-4b7f-8358-18c216c7e829]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:49:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-28a40cb8-a2d4-4c68-8f8c-b80d772d1f71 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa036d94-7012-44dd-89a9-86ec415a3af1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:10 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa036d94-7012-44dd-89a9-86ec415a3af1 Jul 24 09:49:10 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:10 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-28a40cb8-a2d4-4c68-8f8c-b80d772d1f71 tempest-VolumesGetTest-365468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa036d94-7012-44dd-89a9-86ec415a3af1" returned: 0 in 0.453s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-28a40cb8-a2d4-4c68-8f8c-b80d772d1f71 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa036d94-7012-44dd-89a9-86ec415a3af1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:10 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa036d94-7012-44dd-89a9-86ec415a3af1 Jul 24 09:49:10 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:11 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:11 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-16442e5a-5d72-4fa3-a575-73059489e01f tempest-TestShelveInstance-710840937 None] Terminate volume connection completed successfully. Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-16442e5a-5d72-4fa3-a575-73059489e01f tempest-TestShelveInstance-710840937 None] Deleting attachment bf73b549-e071-4cd4-af81-754ed52fd4f0. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-28a40cb8-a2d4-4c68-8f8c-b80d772d1f71 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa036d94-7012-44dd-89a9-86ec415a3af1" returned: 0 in 0.323s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-28a40cb8-a2d4-4c68-8f8c-b80d772d1f71 tempest-VolumesGetTest-365468319 None] Lock "cinder-quobyte-fa036d94-7012-44dd-89a9-86ec415a3af1" released by "delete_volume" :: held 0.876s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-28a40cb8-a2d4-4c68-8f8c-b80d772d1f71 tempest-VolumesGetTest-365468319 None] Created reservations ['1163b9c6-fe4c-4779-b43a-d42ba5cc2d15', 'b8b82278-0a55-4b9d-a74c-2055ef36db1f', '05d104d4-6479-42eb-a331-fe29c2da534a', 'f0c1e1e8-3e7c-4758-b1ba-223e38b004f3'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-28a40cb8-a2d4-4c68-8f8c-b80d772d1f71 tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-28a40cb8-a2d4-4c68-8f8c-b80d772d1f71 tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-28a40cb8-a2d4-4c68-8f8c-b80d772d1f71 tempest-VolumesGetTest-365468319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-28a40cb8-a2d4-4c68-8f8c-b80d772d1f71 tempest-VolumesGetTest-365468319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-28a40cb8-a2d4-4c68-8f8c-b80d772d1f71 tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-28a40cb8-a2d4-4c68-8f8c-b80d772d1f71 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-5b33af63-e103-4278-a790-c2bf544deb6e tempest-TestShelveInstance-710840937 None] Acquiring lock "cinder-1812af6a-17c6-4573-aa4a-c86d480ad012-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:11 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:49:11 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-5b33af63-e103-4278-a790-c2bf544deb6e tempest-TestShelveInstance-710840937 None] Lock "cinder-1812af6a-17c6-4573-aa4a-c86d480ad012-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c66cfb69-c16b-4cb4-8cdf-f9f1d22a0cf3 tempest-VolumesGetTest-365468319 None] Acquiring lock "cinder-f7bab2e0-6fdc-479d-a128-58b43a7ce52f-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-5b33af63-e103-4278-a790-c2bf544deb6e tempest-TestShelveInstance-710840937 None] Acquiring lock "cinder-quobyte-1812af6a-17c6-4573-aa4a-c86d480ad012" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c66cfb69-c16b-4cb4-8cdf-f9f1d22a0cf3 tempest-VolumesGetTest-365468319 None] Lock "cinder-f7bab2e0-6fdc-479d-a128-58b43a7ce52f-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-5b33af63-e103-4278-a790-c2bf544deb6e tempest-TestShelveInstance-710840937 None] Lock "cinder-quobyte-1812af6a-17c6-4573-aa4a-c86d480ad012" acquired by "delete_volume" :: waited 0.033s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[50721041-21c5-4a6d-a87e-996ceea9381e]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-5b33af63-e103-4278-a790-c2bf544deb6e tempest-TestShelveInstance-710840937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1812af6a-17c6-4573-aa4a-c86d480ad012 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c66cfb69-c16b-4cb4-8cdf-f9f1d22a0cf3 tempest-VolumesGetTest-365468319 None] Acquiring lock "cinder-quobyte-f7bab2e0-6fdc-479d-a128-58b43a7ce52f" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c66cfb69-c16b-4cb4-8cdf-f9f1d22a0cf3 tempest-VolumesGetTest-365468319 None] Lock "cinder-quobyte-f7bab2e0-6fdc-479d-a128-58b43a7ce52f" acquired by "delete_volume" :: waited 0.034s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f4270b-e04a-41c9-a764-f5f7c0b292d1]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c66cfb69-c16b-4cb4-8cdf-f9f1d22a0cf3 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:11 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1812af6a-17c6-4573-aa4a-c86d480ad012 Jul 24 09:49:11 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:11 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-28a40cb8-a2d4-4c68-8f8c-b80d772d1f71 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.533s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-28a40cb8-a2d4-4c68-8f8c-b80d772d1f71 tempest-VolumesGetTest-365468319 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:49:11 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-28a40cb8-a2d4-4c68-8f8c-b80d772d1f71 tempest-VolumesGetTest-365468319 None] Deleted volume successfully. Jul 24 09:49:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-28a40cb8-a2d4-4c68-8f8c-b80d772d1f71 tempest-VolumesGetTest-365468319 None] Lock "cinder-fa036d94-7012-44dd-89a9-86ec415a3af1-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:11 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f Jul 24 09:49:11 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:12 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-5b33af63-e103-4278-a790-c2bf544deb6e tempest-TestShelveInstance-710840937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1812af6a-17c6-4573-aa4a-c86d480ad012" returned: 0 in 0.497s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-5b33af63-e103-4278-a790-c2bf544deb6e tempest-TestShelveInstance-710840937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1812af6a-17c6-4573-aa4a-c86d480ad012 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:12 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1812af6a-17c6-4573-aa4a-c86d480ad012 Jul 24 09:49:12 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:12 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c66cfb69-c16b-4cb4-8cdf-f9f1d22a0cf3 tempest-VolumesGetTest-365468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f" returned: 0 in 0.602s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c66cfb69-c16b-4cb4-8cdf-f9f1d22a0cf3 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:12 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f Jul 24 09:49:12 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:12 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-5b33af63-e103-4278-a790-c2bf544deb6e tempest-TestShelveInstance-710840937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1812af6a-17c6-4573-aa4a-c86d480ad012" returned: 0 in 0.352s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-5b33af63-e103-4278-a790-c2bf544deb6e tempest-TestShelveInstance-710840937 None] Lock "cinder-quobyte-1812af6a-17c6-4573-aa4a-c86d480ad012" released by "delete_volume" :: held 0.933s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG cinder.quota [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-5b33af63-e103-4278-a790-c2bf544deb6e tempest-TestShelveInstance-710840937 None] Created reservations ['e106d092-ade1-4249-9329-f5bc5e87113f', 'd18e6d9d-5b86-4f51-8832-16cd769c4fd6', '5a3b8b89-62c0-49b7-99e4-7bff65446f8a', '1bea15f0-4670-4a11-8eca-e721d73d6564'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:49:12 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c66cfb69-c16b-4cb4-8cdf-f9f1d22a0cf3 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f7bab2e0-6fdc-479d-a128-58b43a7ce52f" returned: 0 in 0.367s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c66cfb69-c16b-4cb4-8cdf-f9f1d22a0cf3 tempest-VolumesGetTest-365468319 None] Lock "cinder-quobyte-f7bab2e0-6fdc-479d-a128-58b43a7ce52f" released by "delete_volume" :: held 1.049s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-5b33af63-e103-4278-a790-c2bf544deb6e tempest-TestShelveInstance-710840937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-5b33af63-e103-4278-a790-c2bf544deb6e tempest-TestShelveInstance-710840937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-5b33af63-e103-4278-a790-c2bf544deb6e tempest-TestShelveInstance-710840937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-5b33af63-e103-4278-a790-c2bf544deb6e tempest-TestShelveInstance-710840937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-5b33af63-e103-4278-a790-c2bf544deb6e tempest-TestShelveInstance-710840937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-5b33af63-e103-4278-a790-c2bf544deb6e tempest-TestShelveInstance-710840937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:12 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:49:12 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-c66cfb69-c16b-4cb4-8cdf-f9f1d22a0cf3 tempest-VolumesGetTest-365468319 None] Created reservations ['ecc2bc21-8565-47a2-9098-a62ead1aa505', '819c4d8c-5808-411a-9667-8ae158b903c3', '8f9f77c1-7dd2-4208-900c-bc43d7c6c800', '07126fb2-1f50-46e0-aad7-823dc7ccc8ed'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c66cfb69-c16b-4cb4-8cdf-f9f1d22a0cf3 tempest-VolumesGetTest-365468319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c66cfb69-c16b-4cb4-8cdf-f9f1d22a0cf3 tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c66cfb69-c16b-4cb4-8cdf-f9f1d22a0cf3 tempest-VolumesGetTest-365468319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c66cfb69-c16b-4cb4-8cdf-f9f1d22a0cf3 tempest-VolumesGetTest-365468319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c66cfb69-c16b-4cb4-8cdf-f9f1d22a0cf3 tempest-VolumesGetTest-365468319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c66cfb69-c16b-4cb4-8cdf-f9f1d22a0cf3 tempest-VolumesGetTest-365468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:13 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:49:13 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:13 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-5b33af63-e103-4278-a790-c2bf544deb6e tempest-TestShelveInstance-710840937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.355s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:13 devstack cinder-volume[88488]: DEBUG cinder.manager [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-5b33af63-e103-4278-a790-c2bf544deb6e tempest-TestShelveInstance-710840937 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:49:13 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-5b33af63-e103-4278-a790-c2bf544deb6e tempest-TestShelveInstance-710840937 None] Deleted volume successfully. Jul 24 09:49:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [req-fd095f83-10b8-434c-b4cf-598c3017a337 req-5b33af63-e103-4278-a790-c2bf544deb6e tempest-TestShelveInstance-710840937 None] Lock "cinder-1812af6a-17c6-4573-aa4a-c86d480ad012-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:13 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c66cfb69-c16b-4cb4-8cdf-f9f1d22a0cf3 tempest-VolumesGetTest-365468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.303s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:13 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-c66cfb69-c16b-4cb4-8cdf-f9f1d22a0cf3 tempest-VolumesGetTest-365468319 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:49:13 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c66cfb69-c16b-4cb4-8cdf-f9f1d22a0cf3 tempest-VolumesGetTest-365468319 None] Deleted volume successfully. Jul 24 09:49:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c66cfb69-c16b-4cb4-8cdf-f9f1d22a0cf3 tempest-VolumesGetTest-365468319 None] Lock "cinder-f7bab2e0-6fdc-479d-a128-58b43a7ce52f-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:49:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:49:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:49:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:15 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:49:15 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:15 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.283s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:49:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:49:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 28 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:49:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:49:23 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=136,cinder:DELETE=10,cinder:SELECT=86,cinder:INSERT=44 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:49:25 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=137,cinder:SELECT=117,cinder:DELETE=12,cinder:INSERT=36 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:49:31 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:49:31 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Flow 'volume_create_manager' (52917f04-5913-48ba-b56a-b26c2988fa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:49:31 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40967d8e-0ad4-4f3a-aef5-b790b7cba020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:31 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40967d8e-0ad4-4f3a-aef5-b790b7cba020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1020191453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1614fc9-dc9a-4d9b-98c3-1d615774b63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c099a7c03107468cbc192b3f275bb299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:49:32Z,use_quota=True,user_id='199f0194d045445bb3ab2e8480e48624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:31 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5ab62d-9c54-4ceb-9aaf-5b2f27febe3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:31 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5ab62d-9c54-4ceb-9aaf-5b2f27febe3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:31 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce6c72a-3ea8-4c43-9554-606e8583744b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:31 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce6c72a-3ea8-4c43-9554-606e8583744b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1614fc9-dc9a-4d9b-98c3-1d615774b63c', 'volume_name': 'volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f0dc23a-fb61-4f7d-8c22-00f09c85fc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f0dc23a-fb61-4f7d-8c22-00f09c85fc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fcc0f0-52c8-4acd-9186-da2525c1ef68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:32 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Volume f1614fc9-dc9a-4d9b-98c3-1d615774b63c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c', 'volume_size': 1} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1020191453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1614fc9-dc9a-4d9b-98c3-1d615774b63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c099a7c03107468cbc192b3f275bb299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:49:32Z,use_quota=True,user_id='199f0194d045445bb3ab2e8480e48624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Creating volume f1614fc9-dc9a-4d9b-98c3-1d615774b63c {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:49:32 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:32 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c 1073741824 Jul 24 09:49:32 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Flow 'volume_create_manager' (a3df7c79-0317-4c65-b937-99b777d78ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac403c9-c930-4952-bca4-13b58922c5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac403c9-c930-4952-bca4-13b58922c5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2133975376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f35ff4-5614-4d5a-9ac3-d7416714971f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019d3e4f039e49cc8120a113657efe35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:49:32Z,use_quota=True,user_id='157c2b35abb648999dc23e8232b0fc8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16880c31-8aee-4be9-83d6-08f12c82b5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16880c31-8aee-4be9-83d6-08f12c82b5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143ad768-e7a3-4c40-8d18-d49d7a7d4da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143ad768-e7a3-4c40-8d18-d49d7a7d4da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88f35ff4-5614-4d5a-9ac3-d7416714971f', 'volume_name': 'volume-88f35ff4-5614-4d5a-9ac3-d7416714971f', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f5895b-0f69-41aa-bd9a-2e46c812792b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f5895b-0f69-41aa-bd9a-2e46c812792b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d879b5ec-b0a1-461f-9dfb-89a2ddeaaf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:32 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Volume 88f35ff4-5614-4d5a-9ac3-d7416714971f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88f35ff4-5614-4d5a-9ac3-d7416714971f', 'volume_size': 1} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:32 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c 1073741824" returned: 0 in 0.568s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:32 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c Jul 24 09:49:32 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:32 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c" returned: 0 in 0.280s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.428s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2133975376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f35ff4-5614-4d5a-9ac3-d7416714971f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019d3e4f039e49cc8120a113657efe35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:49:32Z,use_quota=True,user_id='157c2b35abb648999dc23e8232b0fc8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Creating volume 88f35ff4-5614-4d5a-9ac3-d7416714971f {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:49:32 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fcc0f0-52c8-4acd-9186-da2525c1ef68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a8d128-869f-4ee0-afd7-7c6f55a0cd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:32 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f 1073741824 Jul 24 09:49:32 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:32 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Volume volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c (f1614fc9-dc9a-4d9b-98c3-1d615774b63c): created successfully Jul 24 09:49:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a8d128-869f-4ee0-afd7-7c6f55a0cd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Flow 'volume_create_manager' (52917f04-5913-48ba-b56a-b26c2988fa13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:49:33 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-be0f164f-e9d5-4496-9012-0fc4e7742a19 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Created volume successfully. Jul 24 09:49:33 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f 1073741824" returned: 0 in 0.549s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:33 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f Jul 24 09:49:33 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:33 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f" returned: 0 in 0.279s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:49:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d879b5ec-b0a1-461f-9dfb-89a2ddeaaf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88f35ff4-5614-4d5a-9ac3-d7416714971f', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (158d8264-83f7-40e0-8271-f04b3e45d019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:33 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Volume volume-88f35ff4-5614-4d5a-9ac3-d7416714971f (88f35ff4-5614-4d5a-9ac3-d7416714971f): created successfully Jul 24 09:49:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (158d8264-83f7-40e0-8271-f04b3e45d019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Flow 'volume_create_manager' (a3df7c79-0317-4c65-b937-99b777d78ffb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:49:33 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-cc8b58bf-75f9-4ff5-b64d-97d5f77aeda0 tempest-TestStampPattern-1960194961 None] Created volume successfully. Jul 24 09:49:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-81491c0c-5e00-4cf4-b097-9f00f6bc788e tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-81491c0c-5e00-4cf4-b097-9f00f6bc788e tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:34 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-81491c0c-5e00-4cf4-b097-9f00f6bc788e tempest-CreateVolumesFromSnapshotTest-1495953147 None] Creating offline snapshot d2b5b727-8266-4f82-a32d-a8f97df085c0 of volume f1614fc9-dc9a-4d9b-98c3-1d615774b63c {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:49:34 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2167602-8d34-43f2-a5bd-897cbb68e311]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:49:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-81491c0c-5e00-4cf4-b097-9f00f6bc788e tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:34 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c Jul 24 09:49:34 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:34 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-81491c0c-5e00-4cf4-b097-9f00f6bc788e tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c" returned: 0 in 0.514s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-81491c0c-5e00-4cf4-b097-9f00f6bc788e tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.d2b5b727-8266-4f82-a32d-a8f97df085c0 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:34 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.d2b5b727-8266-4f82-a32d-a8f97df085c0 1G Jul 24 09:49:34 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:35 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-81491c0c-5e00-4cf4-b097-9f00f6bc788e tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.d2b5b727-8266-4f82-a32d-a8f97df085c0 1G" returned: 0 in 0.538s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-81491c0c-5e00-4cf4-b097-9f00f6bc788e tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.d2b5b727-8266-4f82-a32d-a8f97df085c0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:35 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.d2b5b727-8266-4f82-a32d-a8f97df085c0 Jul 24 09:49:35 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:35 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-81491c0c-5e00-4cf4-b097-9f00f6bc788e tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.d2b5b727-8266-4f82-a32d-a8f97df085c0" returned: 0 in 0.397s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:35 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-81491c0c-5e00-4cf4-b097-9f00f6bc788e tempest-CreateVolumesFromSnapshotTest-1495953147 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.d2b5b727-8266-4f82-a32d-a8f97df085c0 is being set with open permissions: ugo+rw Jul 24 09:49:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-81491c0c-5e00-4cf4-b097-9f00f6bc788e tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.d2b5b727-8266-4f82-a32d-a8f97df085c0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:35 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.d2b5b727-8266-4f82-a32d-a8f97df085c0 Jul 24 09:49:35 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:35 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-81491c0c-5e00-4cf4-b097-9f00f6bc788e tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.d2b5b727-8266-4f82-a32d-a8f97df085c0" returned: 0 in 0.309s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-81491c0c-5e00-4cf4-b097-9f00f6bc788e tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:36 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.info Jul 24 09:49:36 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:36 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-81491c0c-5e00-4cf4-b097-9f00f6bc788e tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.info" returned: 0 in 0.320s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:36 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-81491c0c-5e00-4cf4-b097-9f00f6bc788e tempest-CreateVolumesFromSnapshotTest-1495953147 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.info is being set with open permissions: ugo+rw Jul 24 09:49:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-81491c0c-5e00-4cf4-b097-9f00f6bc788e tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:36 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.info Jul 24 09:49:36 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:36 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-81491c0c-5e00-4cf4-b097-9f00f6bc788e tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.info" returned: 0 in 0.304s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-81491c0c-5e00-4cf4-b097-9f00f6bc788e tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.493s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:36 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-81491c0c-5e00-4cf4-b097-9f00f6bc788e tempest-CreateVolumesFromSnapshotTest-1495953147 None] Create snapshot completed successfully Jul 24 09:49:37 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Flow 'volume_create_manager' (e3224144-7aab-48bb-b8e7-789f07827b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9901ae10-114c-4810-9027-89ced29fbd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9901ae10-114c-4810-9027-89ced29fbd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-357327903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d6df0a-8265-4bf6-a891-e308e61b69ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c099a7c03107468cbc192b3f275bb299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:49:38Z,use_quota=True,user_id='199f0194d045445bb3ab2e8480e48624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e4c4af-5d5d-4237-aeee-10011ef5eeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e4c4af-5d5d-4237-aeee-10011ef5eeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d783b1-5e42-47fb-bcf3-97ff0d4b92df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d783b1-5e42-47fb-bcf3-97ff0d4b92df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2d6df0a-8265-4bf6-a891-e308e61b69ad', 'volume_name': 'volume-c2d6df0a-8265-4bf6-a891-e308e61b69ad', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5988d9c1-0f81-4c0b-bd9c-dd3fa8f736d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5988d9c1-0f81-4c0b-bd9c-dd3fa8f736d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52971b32-b4e0-4b46-a10f-c45657231717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:38 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Volume c2d6df0a-8265-4bf6-a891-e308e61b69ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2d6df0a-8265-4bf6-a891-e308e61b69ad', 'volume_size': 1} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-357327903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d6df0a-8265-4bf6-a891-e308e61b69ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c099a7c03107468cbc192b3f275bb299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:49:38Z,use_quota=True,user_id='199f0194d045445bb3ab2e8480e48624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Creating volume c2d6df0a-8265-4bf6-a891-e308e61b69ad {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:49:38 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2d6df0a-8265-4bf6-a891-e308e61b69ad 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:38 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2d6df0a-8265-4bf6-a891-e308e61b69ad 1073741824 Jul 24 09:49:38 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Flow 'volume_create_manager' (d62e730b-a608-4fe1-b2bf-5ad0b252fdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ac3217-c67f-46bd-bc7b-ef8f351385be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ac3217-c67f-46bd-bc7b-ef8f351385be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-241341108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11edc089-c297-4e46-b460-fb5f87bddbd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c099a7c03107468cbc192b3f275bb299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:49:38Z,use_quota=True,user_id='199f0194d045445bb3ab2e8480e48624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a7edf6-2fb1-4049-b144-67fbe6756b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a7edf6-2fb1-4049-b144-67fbe6756b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2f7f05-7b9b-4b88-a4aa-868277920ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2f7f05-7b9b-4b88-a4aa-868277920ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11edc089-c297-4e46-b460-fb5f87bddbd3', 'volume_name': 'volume-11edc089-c297-4e46-b460-fb5f87bddbd3', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f1b0d1-8464-4251-9ec2-dade446ee578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f1b0d1-8464-4251-9ec2-dade446ee578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de43a8f-372f-4ec4-aee7-ebd975564d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:38 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Volume 11edc089-c297-4e46-b460-fb5f87bddbd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11edc089-c297-4e46-b460-fb5f87bddbd3', 'volume_size': 1} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:38 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2d6df0a-8265-4bf6-a891-e308e61b69ad 1073741824" returned: 0 in 0.737s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2d6df0a-8265-4bf6-a891-e308e61b69ad {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:38 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2d6df0a-8265-4bf6-a891-e308e61b69ad Jul 24 09:49:38 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Flow 'volume_create_manager' (ec901b68-44ff-41d4-b80b-236eb2d58430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c56c32-0081-44d6-a8ae-e62cd152f8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c56c32-0081-44d6-a8ae-e62cd152f8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2028684877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a629915-0598-4e54-a146-e9f562c10b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c099a7c03107468cbc192b3f275bb299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:49:39Z,use_quota=True,user_id='199f0194d045445bb3ab2e8480e48624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf16b833-b226-43c7-8559-ecf7e28cb73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf16b833-b226-43c7-8559-ecf7e28cb73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1036bb-8105-4f6b-b59f-5c1ece30dff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1036bb-8105-4f6b-b59f-5c1ece30dff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a629915-0598-4e54-a146-e9f562c10b75', 'volume_name': 'volume-2a629915-0598-4e54-a146-e9f562c10b75', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:39 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e539bc-5e98-49f0-8d4e-81603f5d2987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e539bc-5e98-49f0-8d4e-81603f5d2987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc3479cc-4b0b-4ae6-b29b-9e50168e637a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:39 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Volume 2a629915-0598-4e54-a146-e9f562c10b75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a629915-0598-4e54-a146-e9f562c10b75', 'volume_size': 1} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2d6df0a-8265-4bf6-a891-e308e61b69ad" returned: 0 in 0.441s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.662s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-241341108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11edc089-c297-4e46-b460-fb5f87bddbd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c099a7c03107468cbc192b3f275bb299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:49:38Z,use_quota=True,user_id='199f0194d045445bb3ab2e8480e48624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Creating volume 11edc089-c297-4e46-b460-fb5f87bddbd3 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:49:39 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-11edc089-c297-4e46-b460-fb5f87bddbd3 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52971b32-b4e0-4b46-a10f-c45657231717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2d6df0a-8265-4bf6-a891-e308e61b69ad', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f536540a-f4e3-4bf5-b90a-88fd1cf1b4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:39 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-11edc089-c297-4e46-b460-fb5f87bddbd3 1073741824 Jul 24 09:49:39 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:39 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Volume volume-c2d6df0a-8265-4bf6-a891-e308e61b69ad (c2d6df0a-8265-4bf6-a891-e308e61b69ad): created successfully Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f536540a-f4e3-4bf5-b90a-88fd1cf1b4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Flow 'volume_create_manager' (e3224144-7aab-48bb-b8e7-789f07827b88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:49:39 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-6aee1a44-129a-426a-ab0a-aefde19a25bd tempest-CreateVolumesFromSnapshotTest-1495953147 None] Created volume successfully. Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Flow 'volume_create_manager' (e84f484f-09cd-4045-96b7-ab61e5ef84ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060ce58f-be2e-4169-ab6a-2601b3cae4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060ce58f-be2e-4169-ab6a-2601b3cae4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-543403770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a3da3b-9047-4723-b12e-5dedd27967e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c099a7c03107468cbc192b3f275bb299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:49:40Z,use_quota=True,user_id='199f0194d045445bb3ab2e8480e48624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7cd11f-73e2-4554-9793-de0c24a5d3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7cd11f-73e2-4554-9793-de0c24a5d3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba0b088-d64a-44d0-9c99-281c72eba9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba0b088-d64a-44d0-9c99-281c72eba9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87a3da3b-9047-4723-b12e-5dedd27967e5', 'volume_name': 'volume-87a3da3b-9047-4723-b12e-5dedd27967e5', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd70e62-ec0f-4195-b86d-43be25c90f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd70e62-ec0f-4195-b86d-43be25c90f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7313cf7b-718c-4151-837e-d7fe8cdaade3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:39 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Volume 87a3da3b-9047-4723-b12e-5dedd27967e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87a3da3b-9047-4723-b12e-5dedd27967e5', 'volume_size': 1} Jul 24 09:49:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Flow 'volume_create_manager' (395d0430-02cd-47fc-83f0-32bbc6af7e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f244577f-30a9-481c-9ee0-9bca4d526bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f244577f-30a9-481c-9ee0-9bca4d526bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-231720143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c099a7c03107468cbc192b3f275bb299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:49:40Z,use_quota=True,user_id='199f0194d045445bb3ab2e8480e48624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796e18ec-f646-4598-bb8a-1797d7995e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:40 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796e18ec-f646-4598-bb8a-1797d7995e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37ba36a-0017-4bec-a795-a25807e8c279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37ba36a-0017-4bec-a795-a25807e8c279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8', 'volume_name': 'volume-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53f2049-c76c-41a4-8d23-51b8849fae6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53f2049-c76c-41a4-8d23-51b8849fae6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404fd1ac-3973-462c-bda9-755728ad0bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:40 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Volume 5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8', 'volume_size': 1} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-11edc089-c297-4e46-b460-fb5f87bddbd3 1073741824" returned: 0 in 1.175s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-11edc089-c297-4e46-b460-fb5f87bddbd3 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:40 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-11edc089-c297-4e46-b460-fb5f87bddbd3 Jul 24 09:49:40 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:40 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-11edc089-c297-4e46-b460-fb5f87bddbd3" returned: 0 in 0.317s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.616s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2028684877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a629915-0598-4e54-a146-e9f562c10b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c099a7c03107468cbc192b3f275bb299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:49:39Z,use_quota=True,user_id='199f0194d045445bb3ab2e8480e48624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Creating volume 2a629915-0598-4e54-a146-e9f562c10b75 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:49:40 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2a629915-0598-4e54-a146-e9f562c10b75 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de43a8f-372f-4ec4-aee7-ebd975564d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11edc089-c297-4e46-b460-fb5f87bddbd3', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1d4cf4-6150-46bb-a517-e1eed73eb0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:40 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2a629915-0598-4e54-a146-e9f562c10b75 1073741824 Jul 24 09:49:40 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:40 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Volume volume-11edc089-c297-4e46-b460-fb5f87bddbd3 (11edc089-c297-4e46-b460-fb5f87bddbd3): created successfully Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1d4cf4-6150-46bb-a517-e1eed73eb0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Flow 'volume_create_manager' (d62e730b-a608-4fe1-b2bf-5ad0b252fdd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:49:41 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-2e222fc5-eac8-47fe-96d3-53c5e7d06ece tempest-CreateVolumesFromSnapshotTest-1495953147 None] Created volume successfully. Jul 24 09:49:41 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2a629915-0598-4e54-a146-e9f562c10b75 1073741824" returned: 0 in 0.619s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2a629915-0598-4e54-a146-e9f562c10b75 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:41 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2a629915-0598-4e54-a146-e9f562c10b75 Jul 24 09:49:41 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:41 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2a629915-0598-4e54-a146-e9f562c10b75" returned: 0 in 0.273s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.037s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-543403770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a3da3b-9047-4723-b12e-5dedd27967e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c099a7c03107468cbc192b3f275bb299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:49:40Z,use_quota=True,user_id='199f0194d045445bb3ab2e8480e48624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Creating volume 87a3da3b-9047-4723-b12e-5dedd27967e5 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:49:41 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87a3da3b-9047-4723-b12e-5dedd27967e5 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc3479cc-4b0b-4ae6-b29b-9e50168e637a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a629915-0598-4e54-a146-e9f562c10b75', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac120b95-36fe-4cfb-a5c5-0ceaa75da214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:41 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87a3da3b-9047-4723-b12e-5dedd27967e5 1073741824 Jul 24 09:49:41 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:41 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Volume volume-2a629915-0598-4e54-a146-e9f562c10b75 (2a629915-0598-4e54-a146-e9f562c10b75): created successfully Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac120b95-36fe-4cfb-a5c5-0ceaa75da214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Flow 'volume_create_manager' (ec901b68-44ff-41d4-b80b-236eb2d58430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:49:41 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-45c9bffe-643b-44fc-8400-2d92fa5f90bc tempest-CreateVolumesFromSnapshotTest-1495953147 None] Created volume successfully. Jul 24 09:49:42 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87a3da3b-9047-4723-b12e-5dedd27967e5 1073741824" returned: 0 in 0.746s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87a3da3b-9047-4723-b12e-5dedd27967e5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:42 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87a3da3b-9047-4723-b12e-5dedd27967e5 Jul 24 09:49:42 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:43 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87a3da3b-9047-4723-b12e-5dedd27967e5" returned: 0 in 0.347s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:49:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.518s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-231720143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c099a7c03107468cbc192b3f275bb299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:49:40Z,use_quota=True,user_id='199f0194d045445bb3ab2e8480e48624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:49:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Creating volume 5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:49:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:49:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:49:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:49:43 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:49:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7313cf7b-718c-4151-837e-d7fe8cdaade3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87a3da3b-9047-4723-b12e-5dedd27967e5', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:43 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8 1073741824 Jul 24 09:49:43 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51b0b02-4701-42ec-adf7-50bf130e6448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:43 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Volume volume-87a3da3b-9047-4723-b12e-5dedd27967e5 (87a3da3b-9047-4723-b12e-5dedd27967e5): created successfully Jul 24 09:49:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51b0b02-4701-42ec-adf7-50bf130e6448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Flow 'volume_create_manager' (e84f484f-09cd-4045-96b7-ab61e5ef84ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:49:43 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d56ffe4e-92dd-443a-bd1b-7745a0dc0382 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Created volume successfully. Jul 24 09:49:43 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8 1073741824" returned: 0 in 0.676s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:43 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8 Jul 24 09:49:43 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:44 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8" returned: 0 in 0.613s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:49:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404fd1ac-3973-462c-bda9-755728ad0bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f93b2609-3e46-43fa-8815-993af19fbf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:49:44 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Volume volume-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8 (5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8): created successfully Jul 24 09:49:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f93b2609-3e46-43fa-8815-993af19fbf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:49:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Flow 'volume_create_manager' (395d0430-02cd-47fc-83f0-32bbc6af7e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:49:44 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d9f1a57f-f1fe-4757-8e44-25a8addd46e5 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Created volume successfully. Jul 24 09:49:45 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-832dc7bc-9131-4c41-b0cd-1060f273d04d tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "cinder-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:45 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-832dc7bc-9131-4c41-b0cd-1060f273d04d tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:45 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-832dc7bc-9131-4c41-b0cd-1060f273d04d tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "cinder-quobyte-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:45 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-832dc7bc-9131-4c41-b0cd-1060f273d04d tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-quobyte-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8" acquired by "delete_volume" :: waited 0.023s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:45 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[990b2d01-ee87-449f-a51f-04ad8e4200e9]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:49:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-832dc7bc-9131-4c41-b0cd-1060f273d04d tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:45 devstack sudo[103039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8 Jul 24 09:49:45 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:45 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-832dc7bc-9131-4c41-b0cd-1060f273d04d tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8" returned: 0 in 0.455s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-832dc7bc-9131-4c41-b0cd-1060f273d04d tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:45 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8 Jul 24 09:49:45 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:46 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-832dc7bc-9131-4c41-b0cd-1060f273d04d tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8" returned: 0 in 0.365s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-832dc7bc-9131-4c41-b0cd-1060f273d04d tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-quobyte-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8" released by "delete_volume" :: held 0.885s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:46 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-832dc7bc-9131-4c41-b0cd-1060f273d04d tempest-CreateVolumesFromSnapshotTest-1495953147 None] Created reservations ['fd56f456-70f8-4df8-810b-947822c30e8a', '3ae97374-570b-44a6-9129-5dde99c37cc0', '5a493435-32dc-4835-8e34-138418fa674c', '2440e671-c18f-4195-a0d7-1026b0e5e3b3'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:49:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-832dc7bc-9131-4c41-b0cd-1060f273d04d tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-832dc7bc-9131-4c41-b0cd-1060f273d04d tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-832dc7bc-9131-4c41-b0cd-1060f273d04d tempest-CreateVolumesFromSnapshotTest-1495953147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:49:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-832dc7bc-9131-4c41-b0cd-1060f273d04d tempest-CreateVolumesFromSnapshotTest-1495953147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:49:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-832dc7bc-9131-4c41-b0cd-1060f273d04d tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-832dc7bc-9131-4c41-b0cd-1060f273d04d tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:46 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:49:46 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5ce113a0-c163-4b0b-8d98-d323a83bcd09 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "cinder-87a3da3b-9047-4723-b12e-5dedd27967e5-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5ce113a0-c163-4b0b-8d98-d323a83bcd09 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-87a3da3b-9047-4723-b12e-5dedd27967e5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5ce113a0-c163-4b0b-8d98-d323a83bcd09 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "cinder-quobyte-87a3da3b-9047-4723-b12e-5dedd27967e5" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5ce113a0-c163-4b0b-8d98-d323a83bcd09 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-quobyte-87a3da3b-9047-4723-b12e-5dedd27967e5" acquired by "delete_volume" :: waited 0.028s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:46 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37ed9c4-9d4c-438d-8088-3acc676586c2]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:49:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5ce113a0-c163-4b0b-8d98-d323a83bcd09 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87a3da3b-9047-4723-b12e-5dedd27967e5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:46 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-832dc7bc-9131-4c41-b0cd-1060f273d04d tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.526s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:46 devstack sudo[103049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87a3da3b-9047-4723-b12e-5dedd27967e5 Jul 24 09:49:46 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:46 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-832dc7bc-9131-4c41-b0cd-1060f273d04d tempest-CreateVolumesFromSnapshotTest-1495953147 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:49:46 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-832dc7bc-9131-4c41-b0cd-1060f273d04d tempest-CreateVolumesFromSnapshotTest-1495953147 None] Deleted volume successfully. Jul 24 09:49:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-832dc7bc-9131-4c41-b0cd-1060f273d04d tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-5d3d9dca-f9f6-4f12-acf2-bfe1ea800de8-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:47 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5ce113a0-c163-4b0b-8d98-d323a83bcd09 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87a3da3b-9047-4723-b12e-5dedd27967e5" returned: 0 in 0.666s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5ce113a0-c163-4b0b-8d98-d323a83bcd09 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87a3da3b-9047-4723-b12e-5dedd27967e5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:47 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87a3da3b-9047-4723-b12e-5dedd27967e5 Jul 24 09:49:47 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:47 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5ce113a0-c163-4b0b-8d98-d323a83bcd09 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87a3da3b-9047-4723-b12e-5dedd27967e5" returned: 0 in 0.501s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5ce113a0-c163-4b0b-8d98-d323a83bcd09 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-quobyte-87a3da3b-9047-4723-b12e-5dedd27967e5" released by "delete_volume" :: held 1.237s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:47 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-5ce113a0-c163-4b0b-8d98-d323a83bcd09 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Created reservations ['8801cc51-64d6-4e51-b223-9cd6938b0d16', 'c78f5afb-f691-4e8b-98ca-57808f70f555', '0325bda1-9fd9-4d38-8b71-c85adfbfd45a', 'ec65d614-486a-4064-a6b6-5c4a512e9e86'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:49:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5ce113a0-c163-4b0b-8d98-d323a83bcd09 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5ce113a0-c163-4b0b-8d98-d323a83bcd09 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:48 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-5ce113a0-c163-4b0b-8d98-d323a83bcd09 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:49:48 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-5ce113a0-c163-4b0b-8d98-d323a83bcd09 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:49:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5ce113a0-c163-4b0b-8d98-d323a83bcd09 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5ce113a0-c163-4b0b-8d98-d323a83bcd09 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:48 devstack sudo[103058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:49:48 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:48 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5ce113a0-c163-4b0b-8d98-d323a83bcd09 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.336s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:48 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-5ce113a0-c163-4b0b-8d98-d323a83bcd09 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:49:48 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-5ce113a0-c163-4b0b-8d98-d323a83bcd09 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Deleted volume successfully. Jul 24 09:49:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5ce113a0-c163-4b0b-8d98-d323a83bcd09 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-87a3da3b-9047-4723-b12e-5dedd27967e5-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cad310f6-b0ab-4335-867f-c628fb175935 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "cinder-2a629915-0598-4e54-a146-e9f562c10b75-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cad310f6-b0ab-4335-867f-c628fb175935 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-2a629915-0598-4e54-a146-e9f562c10b75-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cad310f6-b0ab-4335-867f-c628fb175935 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "cinder-quobyte-2a629915-0598-4e54-a146-e9f562c10b75" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cad310f6-b0ab-4335-867f-c628fb175935 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-quobyte-2a629915-0598-4e54-a146-e9f562c10b75" acquired by "delete_volume" :: waited 0.028s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:49 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f556429-c119-4a72-add4-c7d1727cdb7b]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:49:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cad310f6-b0ab-4335-867f-c628fb175935 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2a629915-0598-4e54-a146-e9f562c10b75 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:49 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2a629915-0598-4e54-a146-e9f562c10b75 Jul 24 09:49:49 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:49 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cad310f6-b0ab-4335-867f-c628fb175935 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2a629915-0598-4e54-a146-e9f562c10b75" returned: 0 in 0.542s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cad310f6-b0ab-4335-867f-c628fb175935 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2a629915-0598-4e54-a146-e9f562c10b75 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:49 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2a629915-0598-4e54-a146-e9f562c10b75 Jul 24 09:49:49 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:50 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cad310f6-b0ab-4335-867f-c628fb175935 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2a629915-0598-4e54-a146-e9f562c10b75" returned: 0 in 0.368s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:50 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cad310f6-b0ab-4335-867f-c628fb175935 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-quobyte-2a629915-0598-4e54-a146-e9f562c10b75" released by "delete_volume" :: held 0.973s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:50 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-cad310f6-b0ab-4335-867f-c628fb175935 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Created reservations ['689bec54-f8c7-4171-b2b3-c037860b6f65', '454d1950-6e50-4c5d-b355-624542a4a043', 'e8ba4bed-b9d1-4bb7-a5ee-0d63069dee93', '15914298-f223-4d59-8fe8-cd8159b9b435'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:49:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cad310f6-b0ab-4335-867f-c628fb175935 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cad310f6-b0ab-4335-867f-c628fb175935 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:50 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cad310f6-b0ab-4335-867f-c628fb175935 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:49:50 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cad310f6-b0ab-4335-867f-c628fb175935 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:49:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cad310f6-b0ab-4335-867f-c628fb175935 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cad310f6-b0ab-4335-867f-c628fb175935 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:50 devstack sudo[103070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:49:50 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:50 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cad310f6-b0ab-4335-867f-c628fb175935 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.400s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:50 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-cad310f6-b0ab-4335-867f-c628fb175935 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:49:50 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-cad310f6-b0ab-4335-867f-c628fb175935 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Deleted volume successfully. Jul 24 09:49:50 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cad310f6-b0ab-4335-867f-c628fb175935 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-2a629915-0598-4e54-a146-e9f562c10b75-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3c218563-7101-4bea-b5ea-0c2743dd6ab9 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "cinder-11edc089-c297-4e46-b460-fb5f87bddbd3-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3c218563-7101-4bea-b5ea-0c2743dd6ab9 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-11edc089-c297-4e46-b460-fb5f87bddbd3-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3c218563-7101-4bea-b5ea-0c2743dd6ab9 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "cinder-quobyte-11edc089-c297-4e46-b460-fb5f87bddbd3" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3c218563-7101-4bea-b5ea-0c2743dd6ab9 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-quobyte-11edc089-c297-4e46-b460-fb5f87bddbd3" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:51 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0b9e74-4106-41e5-bc15-78ec1cceafa4]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:49:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3c218563-7101-4bea-b5ea-0c2743dd6ab9 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-11edc089-c297-4e46-b460-fb5f87bddbd3 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:51 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-11edc089-c297-4e46-b460-fb5f87bddbd3 Jul 24 09:49:51 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:51 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3c218563-7101-4bea-b5ea-0c2743dd6ab9 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-11edc089-c297-4e46-b460-fb5f87bddbd3" returned: 0 in 0.427s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3c218563-7101-4bea-b5ea-0c2743dd6ab9 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-11edc089-c297-4e46-b460-fb5f87bddbd3 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:51 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-11edc089-c297-4e46-b460-fb5f87bddbd3 Jul 24 09:49:51 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:52 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3c218563-7101-4bea-b5ea-0c2743dd6ab9 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-11edc089-c297-4e46-b460-fb5f87bddbd3" returned: 0 in 0.286s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3c218563-7101-4bea-b5ea-0c2743dd6ab9 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-quobyte-11edc089-c297-4e46-b460-fb5f87bddbd3" released by "delete_volume" :: held 0.771s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:52 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-3c218563-7101-4bea-b5ea-0c2743dd6ab9 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Created reservations ['99c080a4-3071-4499-81b1-07abc27ce26b', 'b8a78e1d-bee0-4c4a-adbf-3c9100dfb7f4', '1edcfe04-9192-43d1-87f5-5f8cd32326c4', 'b0f201f8-4518-466f-9568-1524ee1b3744'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:49:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3c218563-7101-4bea-b5ea-0c2743dd6ab9 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3c218563-7101-4bea-b5ea-0c2743dd6ab9 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3c218563-7101-4bea-b5ea-0c2743dd6ab9 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:49:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3c218563-7101-4bea-b5ea-0c2743dd6ab9 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:49:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3c218563-7101-4bea-b5ea-0c2743dd6ab9 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3c218563-7101-4bea-b5ea-0c2743dd6ab9 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:52 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:49:52 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-10a91b87-d88c-40d7-ac03-fd77315996ed tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "cinder-c2d6df0a-8265-4bf6-a891-e308e61b69ad-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-10a91b87-d88c-40d7-ac03-fd77315996ed tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-c2d6df0a-8265-4bf6-a891-e308e61b69ad-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-10a91b87-d88c-40d7-ac03-fd77315996ed tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "cinder-quobyte-c2d6df0a-8265-4bf6-a891-e308e61b69ad" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-10a91b87-d88c-40d7-ac03-fd77315996ed tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-quobyte-c2d6df0a-8265-4bf6-a891-e308e61b69ad" acquired by "delete_volume" :: waited 0.021s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:52 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b548fc6-a0c6-4de3-a0da-9e956031eabe]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:49:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-10a91b87-d88c-40d7-ac03-fd77315996ed tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2d6df0a-8265-4bf6-a891-e308e61b69ad {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:52 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3c218563-7101-4bea-b5ea-0c2743dd6ab9 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.397s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:52 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-3c218563-7101-4bea-b5ea-0c2743dd6ab9 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:49:52 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-3c218563-7101-4bea-b5ea-0c2743dd6ab9 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Deleted volume successfully. Jul 24 09:49:52 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2d6df0a-8265-4bf6-a891-e308e61b69ad Jul 24 09:49:52 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3c218563-7101-4bea-b5ea-0c2743dd6ab9 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-11edc089-c297-4e46-b460-fb5f87bddbd3-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:53 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-10a91b87-d88c-40d7-ac03-fd77315996ed tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2d6df0a-8265-4bf6-a891-e308e61b69ad" returned: 0 in 0.474s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-10a91b87-d88c-40d7-ac03-fd77315996ed tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2d6df0a-8265-4bf6-a891-e308e61b69ad {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:53 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2d6df0a-8265-4bf6-a891-e308e61b69ad Jul 24 09:49:53 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:53 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-10a91b87-d88c-40d7-ac03-fd77315996ed tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2d6df0a-8265-4bf6-a891-e308e61b69ad" returned: 0 in 0.245s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-10a91b87-d88c-40d7-ac03-fd77315996ed tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-quobyte-c2d6df0a-8265-4bf6-a891-e308e61b69ad" released by "delete_volume" :: held 0.769s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-10a91b87-d88c-40d7-ac03-fd77315996ed tempest-CreateVolumesFromSnapshotTest-1495953147 None] Created reservations ['9886bc5b-f9e0-4258-8a4e-0950f9a58470', 'e520bfb2-f97d-43df-9aa3-b4a03b8cb3a2', 'c28793b1-c4af-4857-a320-4ff344ddfe6d', 'a8b491f5-35c9-47ce-94cd-fea0a7ae0865'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-10a91b87-d88c-40d7-ac03-fd77315996ed tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-10a91b87-d88c-40d7-ac03-fd77315996ed tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-10a91b87-d88c-40d7-ac03-fd77315996ed tempest-CreateVolumesFromSnapshotTest-1495953147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-10a91b87-d88c-40d7-ac03-fd77315996ed tempest-CreateVolumesFromSnapshotTest-1495953147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-10a91b87-d88c-40d7-ac03-fd77315996ed tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-10a91b87-d88c-40d7-ac03-fd77315996ed tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:53 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:49:53 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "cinder-d2b5b727-8266-4f82-a32d-a8f97df085c0-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-d2b5b727-8266-4f82-a32d-a8f97df085c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "cinder-quobyte-f1614fc9-dc9a-4d9b-98c3-1d615774b63c" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-quobyte-f1614fc9-dc9a-4d9b-98c3-1d615774b63c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "cinder-quobyte-d2b5b727-8266-4f82-a32d-a8f97df085c0" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:53 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-10a91b87-d88c-40d7-ac03-fd77315996ed tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.322s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-10a91b87-d88c-40d7-ac03-fd77315996ed tempest-CreateVolumesFromSnapshotTest-1495953147 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-quobyte-d2b5b727-8266-4f82-a32d-a8f97df085c0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Deleting offline snapshot d2b5b727-8266-4f82-a32d-a8f97df085c0 of volume f1614fc9-dc9a-4d9b-98c3-1d615774b63c {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] snapshot_file for this snap is: volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.d2b5b727-8266-4f82-a32d-a8f97df085c0 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:49:53 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-10a91b87-d88c-40d7-ac03-fd77315996ed tempest-CreateVolumesFromSnapshotTest-1495953147 None] Deleted volume successfully. Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[837fb4ee-c446-4fac-bb23-d82885a713eb]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:49:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.d2b5b727-8266-4f82-a32d-a8f97df085c0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-10a91b87-d88c-40d7-ac03-fd77315996ed tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-c2d6df0a-8265-4bf6-a891-e308e61b69ad-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:54 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.d2b5b727-8266-4f82-a32d-a8f97df085c0 Jul 24 09:49:54 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:54 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.d2b5b727-8266-4f82-a32d-a8f97df085c0" returned: 0 in 0.456s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:49:54 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3742f7a-6e3a-4321-bb7d-e10df4ccb313]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:49:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:54 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c Jul 24 09:49:54 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:54 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c" returned: 0 in 0.386s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.d2b5b727-8266-4f82-a32d-a8f97df085c0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:54 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.d2b5b727-8266-4f82-a32d-a8f97df085c0 Jul 24 09:49:54 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:55 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.d2b5b727-8266-4f82-a32d-a8f97df085c0" returned: 0 in 0.417s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.d2b5b727-8266-4f82-a32d-a8f97df085c0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:55 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.d2b5b727-8266-4f82-a32d-a8f97df085c0 Jul 24 09:49:55 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:55 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c.d2b5b727-8266-4f82-a32d-a8f97df085c0" returned: 0 in 0.276s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:55 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-quobyte-d2b5b727-8266-4f82-a32d-a8f97df085c0" released by "_delete_snapshot" :: held 1.703s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:55 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-quobyte-f1614fc9-dc9a-4d9b-98c3-1d615774b63c" released by "delete_snapshot" :: held 1.731s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:55 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Created reservations ['4ba2e456-422b-4443-8202-2ad4f4c25949', '74e62b45-bfd2-4d25-b32d-38ff12768e8e', '77e4aaaf-6c95-44d9-91b4-fe4986473788', '21b0e6dc-864e-4800-9aa7-6e6fb3a0c396'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:49:55 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Delete snapshot completed successfully. Jul 24 09:49:55 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-84bcfbb3-7010-4244-997b-9210729b9230 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-d2b5b727-8266-4f82-a32d-a8f97df085c0-delete_snapshot" released by "delete_snapshot" :: held 1.900s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2a476fb6-ca87-4892-844f-18d04aa0c573 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "cinder-f1614fc9-dc9a-4d9b-98c3-1d615774b63c-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2a476fb6-ca87-4892-844f-18d04aa0c573 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-f1614fc9-dc9a-4d9b-98c3-1d615774b63c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2a476fb6-ca87-4892-844f-18d04aa0c573 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "cinder-quobyte-f1614fc9-dc9a-4d9b-98c3-1d615774b63c" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:49:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2a476fb6-ca87-4892-844f-18d04aa0c573 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-quobyte-f1614fc9-dc9a-4d9b-98c3-1d615774b63c" acquired by "delete_volume" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:49:56 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a34d5b6-29ea-4b2e-9b6e-47fe620aaa99]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:49:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2a476fb6-ca87-4892-844f-18d04aa0c573 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:56 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c Jul 24 09:49:56 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:56 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2a476fb6-ca87-4892-844f-18d04aa0c573 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c" returned: 0 in 0.385s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2a476fb6-ca87-4892-844f-18d04aa0c573 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:56 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c Jul 24 09:49:56 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:56 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2a476fb6-ca87-4892-844f-18d04aa0c573 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1614fc9-dc9a-4d9b-98c3-1d615774b63c" returned: 0 in 0.254s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2a476fb6-ca87-4892-844f-18d04aa0c573 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-quobyte-f1614fc9-dc9a-4d9b-98c3-1d615774b63c" released by "delete_volume" :: held 0.716s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:49:56 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-2a476fb6-ca87-4892-844f-18d04aa0c573 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Created reservations ['616560e5-e10d-42ed-aa78-9ada1ab2f29a', '8be5b5f3-6043-4e2e-8c2a-29c1ffdd8761', '464c4d29-7b8b-4e65-91aa-7f80411ece3f', '136488e6-d3b4-413f-90f4-bbe9617357f9'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:49:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2a476fb6-ca87-4892-844f-18d04aa0c573 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:49:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2a476fb6-ca87-4892-844f-18d04aa0c573 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:49:57 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2a476fb6-ca87-4892-844f-18d04aa0c573 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:49:57 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2a476fb6-ca87-4892-844f-18d04aa0c573 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:49:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2a476fb6-ca87-4892-844f-18d04aa0c573 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:49:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2a476fb6-ca87-4892-844f-18d04aa0c573 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:49:57 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:49:57 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:49:57 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Jul 24 09:49:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2a476fb6-ca87-4892-844f-18d04aa0c573 tempest-CreateVolumesFromSnapshotTest-1495953147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.265s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:49:57 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-2a476fb6-ca87-4892-844f-18d04aa0c573 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:49:57 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-2a476fb6-ca87-4892-844f-18d04aa0c573 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Deleted volume successfully. Jul 24 09:49:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2a476fb6-ca87-4892-844f-18d04aa0c573 tempest-CreateVolumesFromSnapshotTest-1495953147 None] Lock "cinder-f1614fc9-dc9a-4d9b-98c3-1d615774b63c-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Flow 'volume_create_manager' (32b05723-575a-4837-a756-c28a77d5e3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4eeade-9865-463a-a849-f6cf6c560b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4eeade-9865-463a-a849-f6cf6c560b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1942799729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0b17f2-6969-48fe-81fb-44f84030615a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce447c2c3364ce0b03e232afeeafc88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:50:02Z,use_quota=True,user_id='e78e6300f9434913a2a283047fdb27a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725b2512-518d-4164-ae1a-854fb70dbc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725b2512-518d-4164-ae1a-854fb70dbc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b425ac04-ce27-4a28-a470-913b8ca94c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b425ac04-ce27-4a28-a470-913b8ca94c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e0b17f2-6969-48fe-81fb-44f84030615a', 'volume_name': 'volume-3e0b17f2-6969-48fe-81fb-44f84030615a', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19d65de-a64f-42e2-b2c8-34d3f19a3116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19d65de-a64f-42e2-b2c8-34d3f19a3116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e742d89-1e13-4825-803d-993989cc45d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:01 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Volume 3e0b17f2-6969-48fe-81fb-44f84030615a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e0b17f2-6969-48fe-81fb-44f84030615a', 'volume_size': 1} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1942799729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0b17f2-6969-48fe-81fb-44f84030615a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce447c2c3364ce0b03e232afeeafc88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:50:02Z,use_quota=True,user_id='e78e6300f9434913a2a283047fdb27a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Creating volume 3e0b17f2-6969-48fe-81fb-44f84030615a {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:50:01 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:50:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3e0b17f2-6969-48fe-81fb-44f84030615a 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:01 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3e0b17f2-6969-48fe-81fb-44f84030615a 1073741824 Jul 24 09:50:01 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:02 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3e0b17f2-6969-48fe-81fb-44f84030615a 1073741824" returned: 0 in 0.615s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3e0b17f2-6969-48fe-81fb-44f84030615a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:02 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3e0b17f2-6969-48fe-81fb-44f84030615a Jul 24 09:50:02 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:02 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3e0b17f2-6969-48fe-81fb-44f84030615a" returned: 0 in 0.379s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:50:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:02 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e742d89-1e13-4825-803d-993989cc45d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e0b17f2-6969-48fe-81fb-44f84030615a', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:02 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7594440-220e-4afe-8b8c-c200f775610f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:02 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Volume volume-3e0b17f2-6969-48fe-81fb-44f84030615a (3e0b17f2-6969-48fe-81fb-44f84030615a): created successfully Jul 24 09:50:02 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7594440-220e-4afe-8b8c-c200f775610f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:02 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Flow 'volume_create_manager' (32b05723-575a-4837-a756-c28a77d5e3c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:50:02 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-6d5d1ed2-58a1-4df6-94cc-c3820e874eed tempest-ProjectReaderTests-1850456274 None] Created volume successfully. Jul 24 09:50:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7e7774c7-ac39-4e3f-8912-7fd9f5a4319b tempest-ProjectReaderTests-1850456274 None] Acquiring lock "cinder-3e0b17f2-6969-48fe-81fb-44f84030615a-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:50:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7e7774c7-ac39-4e3f-8912-7fd9f5a4319b tempest-ProjectReaderTests-1850456274 None] Lock "cinder-3e0b17f2-6969-48fe-81fb-44f84030615a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:50:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7e7774c7-ac39-4e3f-8912-7fd9f5a4319b tempest-ProjectReaderTests-1850456274 None] Acquiring lock "cinder-quobyte-3e0b17f2-6969-48fe-81fb-44f84030615a" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:50:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7e7774c7-ac39-4e3f-8912-7fd9f5a4319b tempest-ProjectReaderTests-1850456274 None] Lock "cinder-quobyte-3e0b17f2-6969-48fe-81fb-44f84030615a" acquired by "delete_volume" :: waited 0.030s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:50:04 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a44829-7edf-44b1-81f0-d8c4c2e258c3]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:50:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7e7774c7-ac39-4e3f-8912-7fd9f5a4319b tempest-ProjectReaderTests-1850456274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3e0b17f2-6969-48fe-81fb-44f84030615a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:04 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3e0b17f2-6969-48fe-81fb-44f84030615a Jul 24 09:50:04 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:04 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7e7774c7-ac39-4e3f-8912-7fd9f5a4319b tempest-ProjectReaderTests-1850456274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3e0b17f2-6969-48fe-81fb-44f84030615a" returned: 0 in 0.372s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7e7774c7-ac39-4e3f-8912-7fd9f5a4319b tempest-ProjectReaderTests-1850456274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3e0b17f2-6969-48fe-81fb-44f84030615a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:04 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3e0b17f2-6969-48fe-81fb-44f84030615a Jul 24 09:50:04 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:04 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7e7774c7-ac39-4e3f-8912-7fd9f5a4319b tempest-ProjectReaderTests-1850456274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3e0b17f2-6969-48fe-81fb-44f84030615a" returned: 0 in 0.244s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7e7774c7-ac39-4e3f-8912-7fd9f5a4319b tempest-ProjectReaderTests-1850456274 None] Lock "cinder-quobyte-3e0b17f2-6969-48fe-81fb-44f84030615a" released by "delete_volume" :: held 0.687s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:50:04 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-7e7774c7-ac39-4e3f-8912-7fd9f5a4319b tempest-ProjectReaderTests-1850456274 None] Created reservations ['5ae90a02-e960-49c0-9df3-2cd98e699004', 'a4a090bd-9dcf-46c5-a6c0-782a5821d7c5', 'b9ae01f5-0558-440e-aa0d-383277e7e4f4', '461b3bca-956b-4b87-abaf-bc2dd828e03c'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:50:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7e7774c7-ac39-4e3f-8912-7fd9f5a4319b tempest-ProjectReaderTests-1850456274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7e7774c7-ac39-4e3f-8912-7fd9f5a4319b tempest-ProjectReaderTests-1850456274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7e7774c7-ac39-4e3f-8912-7fd9f5a4319b tempest-ProjectReaderTests-1850456274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:50:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7e7774c7-ac39-4e3f-8912-7fd9f5a4319b tempest-ProjectReaderTests-1850456274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:50:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7e7774c7-ac39-4e3f-8912-7fd9f5a4319b tempest-ProjectReaderTests-1850456274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7e7774c7-ac39-4e3f-8912-7fd9f5a4319b tempest-ProjectReaderTests-1850456274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:04 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:50:04 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:05 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7e7774c7-ac39-4e3f-8912-7fd9f5a4319b tempest-ProjectReaderTests-1850456274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.297s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-7e7774c7-ac39-4e3f-8912-7fd9f5a4319b tempest-ProjectReaderTests-1850456274 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:50:05 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-7e7774c7-ac39-4e3f-8912-7fd9f5a4319b tempest-ProjectReaderTests-1850456274 None] Deleted volume successfully. Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7e7774c7-ac39-4e3f-8912-7fd9f5a4319b tempest-ProjectReaderTests-1850456274 None] Lock "cinder-3e0b17f2-6969-48fe-81fb-44f84030615a-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Flow 'volume_create_manager' (230e8e8d-2127-4ed3-ac75-2b640ee2ded5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1955ed-8a6c-401d-94f0-ab50cc9fcb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1955ed-8a6c-401d-94f0-ab50cc9fcb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1940464919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa10856d-48f3-4e9f-9ebc-f0ab92af617b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce447c2c3364ce0b03e232afeeafc88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:50:06Z,use_quota=True,user_id='e78e6300f9434913a2a283047fdb27a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7a353b-893a-4f60-8aa1-17daa1e51b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7a353b-893a-4f60-8aa1-17daa1e51b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a91edd18-6beb-499c-bece-0c2d72a2fb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a91edd18-6beb-499c-bece-0c2d72a2fb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa10856d-48f3-4e9f-9ebc-f0ab92af617b', 'volume_name': 'volume-fa10856d-48f3-4e9f-9ebc-f0ab92af617b', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac45feeb-f2bc-4c68-b1c1-45fdab7fa560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac45feeb-f2bc-4c68-b1c1-45fdab7fa560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52771c2b-e23a-4519-a53c-6db9826d0cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:05 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Volume fa10856d-48f3-4e9f-9ebc-f0ab92af617b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa10856d-48f3-4e9f-9ebc-f0ab92af617b', 'volume_size': 1} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1940464919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa10856d-48f3-4e9f-9ebc-f0ab92af617b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce447c2c3364ce0b03e232afeeafc88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:50:06Z,use_quota=True,user_id='e78e6300f9434913a2a283047fdb27a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Creating volume fa10856d-48f3-4e9f-9ebc-f0ab92af617b {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:50:05 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:50:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa10856d-48f3-4e9f-9ebc-f0ab92af617b 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:05 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa10856d-48f3-4e9f-9ebc-f0ab92af617b 1073741824 Jul 24 09:50:05 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:06 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa10856d-48f3-4e9f-9ebc-f0ab92af617b 1073741824" returned: 0 in 0.403s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa10856d-48f3-4e9f-9ebc-f0ab92af617b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:06 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa10856d-48f3-4e9f-9ebc-f0ab92af617b Jul 24 09:50:06 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:06 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa10856d-48f3-4e9f-9ebc-f0ab92af617b" returned: 0 in 0.248s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:50:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52771c2b-e23a-4519-a53c-6db9826d0cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa10856d-48f3-4e9f-9ebc-f0ab92af617b', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db95776-f532-4dee-ba79-58413ee45b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:06 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Volume volume-fa10856d-48f3-4e9f-9ebc-f0ab92af617b (fa10856d-48f3-4e9f-9ebc-f0ab92af617b): created successfully Jul 24 09:50:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db95776-f532-4dee-ba79-58413ee45b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Flow 'volume_create_manager' (230e8e8d-2127-4ed3-ac75-2b640ee2ded5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:50:06 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-abd27441-9e1d-4999-8c48-7db3aa1a47a5 tempest-ProjectReaderTests-1850456274 None] Created volume successfully. Jul 24 09:50:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-66f91dca-5ac1-4f13-bf05-bc236447f19a tempest-ProjectReaderTests-1850456274 None] Acquiring lock "cinder-fa10856d-48f3-4e9f-9ebc-f0ab92af617b-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:50:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-66f91dca-5ac1-4f13-bf05-bc236447f19a tempest-ProjectReaderTests-1850456274 None] Lock "cinder-fa10856d-48f3-4e9f-9ebc-f0ab92af617b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:50:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-66f91dca-5ac1-4f13-bf05-bc236447f19a tempest-ProjectReaderTests-1850456274 None] Acquiring lock "cinder-quobyte-fa10856d-48f3-4e9f-9ebc-f0ab92af617b" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:50:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-66f91dca-5ac1-4f13-bf05-bc236447f19a tempest-ProjectReaderTests-1850456274 None] Lock "cinder-quobyte-fa10856d-48f3-4e9f-9ebc-f0ab92af617b" acquired by "delete_volume" :: waited 0.015s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:50:06 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae9b852-85d9-48e7-a85c-90ce6387a6a3]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:50:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-66f91dca-5ac1-4f13-bf05-bc236447f19a tempest-ProjectReaderTests-1850456274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa10856d-48f3-4e9f-9ebc-f0ab92af617b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:06 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa10856d-48f3-4e9f-9ebc-f0ab92af617b Jul 24 09:50:06 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:07 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-66f91dca-5ac1-4f13-bf05-bc236447f19a tempest-ProjectReaderTests-1850456274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa10856d-48f3-4e9f-9ebc-f0ab92af617b" returned: 0 in 0.356s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-66f91dca-5ac1-4f13-bf05-bc236447f19a tempest-ProjectReaderTests-1850456274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa10856d-48f3-4e9f-9ebc-f0ab92af617b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:07 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa10856d-48f3-4e9f-9ebc-f0ab92af617b Jul 24 09:50:07 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:07 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-66f91dca-5ac1-4f13-bf05-bc236447f19a tempest-ProjectReaderTests-1850456274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-fa10856d-48f3-4e9f-9ebc-f0ab92af617b" returned: 0 in 0.264s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-66f91dca-5ac1-4f13-bf05-bc236447f19a tempest-ProjectReaderTests-1850456274 None] Lock "cinder-quobyte-fa10856d-48f3-4e9f-9ebc-f0ab92af617b" released by "delete_volume" :: held 0.661s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:50:07 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-66f91dca-5ac1-4f13-bf05-bc236447f19a tempest-ProjectReaderTests-1850456274 None] Created reservations ['c8d0b1df-d5f3-4287-8666-e00b348c24fa', '55784500-a7c0-4a21-a83c-7c9bffda0d27', 'd4399aee-e3bd-44b7-bf08-67a18f3ea40c', '1e547dbb-485e-4f93-adde-f041bb435514'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:50:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-66f91dca-5ac1-4f13-bf05-bc236447f19a tempest-ProjectReaderTests-1850456274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-66f91dca-5ac1-4f13-bf05-bc236447f19a tempest-ProjectReaderTests-1850456274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-66f91dca-5ac1-4f13-bf05-bc236447f19a tempest-ProjectReaderTests-1850456274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:50:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-66f91dca-5ac1-4f13-bf05-bc236447f19a tempest-ProjectReaderTests-1850456274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:50:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-66f91dca-5ac1-4f13-bf05-bc236447f19a tempest-ProjectReaderTests-1850456274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-66f91dca-5ac1-4f13-bf05-bc236447f19a tempest-ProjectReaderTests-1850456274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:07 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:50:07 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:07 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-66f91dca-5ac1-4f13-bf05-bc236447f19a tempest-ProjectReaderTests-1850456274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.257s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:07 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-66f91dca-5ac1-4f13-bf05-bc236447f19a tempest-ProjectReaderTests-1850456274 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:50:07 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-66f91dca-5ac1-4f13-bf05-bc236447f19a tempest-ProjectReaderTests-1850456274 None] Deleted volume successfully. Jul 24 09:50:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-66f91dca-5ac1-4f13-bf05-bc236447f19a tempest-ProjectReaderTests-1850456274 None] Lock "cinder-fa10856d-48f3-4e9f-9ebc-f0ab92af617b-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Flow 'volume_create_manager' (7400cc59-b15f-4633-af56-61d49050a57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85782a82-83d0-4e5b-9bf0-39096c833aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85782a82-83d0-4e5b-9bf0-39096c833aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-401616265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aab04f6b-5fb8-4a95-bc57-bf27e9971950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce447c2c3364ce0b03e232afeeafc88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:50:08Z,use_quota=True,user_id='e78e6300f9434913a2a283047fdb27a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d98de8fd-b6ac-477a-af79-d1f2de96466d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d98de8fd-b6ac-477a-af79-d1f2de96466d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65ac334-ad1a-458e-96fc-6bd200d16fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65ac334-ad1a-458e-96fc-6bd200d16fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aab04f6b-5fb8-4a95-bc57-bf27e9971950', 'volume_name': 'volume-aab04f6b-5fb8-4a95-bc57-bf27e9971950', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2cf8eb7-89e6-4c6b-90b8-ee5b4a1163be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2cf8eb7-89e6-4c6b-90b8-ee5b4a1163be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a9565c-9315-42e0-b12f-c92d4128f08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:08 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Volume aab04f6b-5fb8-4a95-bc57-bf27e9971950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aab04f6b-5fb8-4a95-bc57-bf27e9971950', 'volume_size': 1} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-401616265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aab04f6b-5fb8-4a95-bc57-bf27e9971950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce447c2c3364ce0b03e232afeeafc88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:50:08Z,use_quota=True,user_id='e78e6300f9434913a2a283047fdb27a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Creating volume aab04f6b-5fb8-4a95-bc57-bf27e9971950 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:50:08 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-aab04f6b-5fb8-4a95-bc57-bf27e9971950 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:08 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-aab04f6b-5fb8-4a95-bc57-bf27e9971950 1073741824 Jul 24 09:50:08 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:08 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-aab04f6b-5fb8-4a95-bc57-bf27e9971950 1073741824" returned: 0 in 0.394s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-aab04f6b-5fb8-4a95-bc57-bf27e9971950 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:08 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-aab04f6b-5fb8-4a95-bc57-bf27e9971950 Jul 24 09:50:08 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:09 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-aab04f6b-5fb8-4a95-bc57-bf27e9971950" returned: 0 in 0.271s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:50:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a9565c-9315-42e0-b12f-c92d4128f08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aab04f6b-5fb8-4a95-bc57-bf27e9971950', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a0d07e-0b6b-48c0-80b1-b3799b993eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:09 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Volume volume-aab04f6b-5fb8-4a95-bc57-bf27e9971950 (aab04f6b-5fb8-4a95-bc57-bf27e9971950): created successfully Jul 24 09:50:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a0d07e-0b6b-48c0-80b1-b3799b993eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Flow 'volume_create_manager' (7400cc59-b15f-4633-af56-61d49050a57d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:50:09 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-0f515e73-2236-4975-a836-661c963d5b80 tempest-ProjectReaderTests-1850456274 None] Created volume successfully. Jul 24 09:50:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-a65e8c2c-82c6-466c-b18e-8d3c70589411 req-d75917af-0413-4328-b740-5650dbcccbcb tempest-TestStampPattern-1960194961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-a65e8c2c-82c6-466c-b18e-8d3c70589411 req-d75917af-0413-4328-b740-5650dbcccbcb tempest-TestStampPattern-1960194961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-a65e8c2c-82c6-466c-b18e-8d3c70589411 req-d75917af-0413-4328-b740-5650dbcccbcb tempest-TestStampPattern-1960194961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-a65e8c2c-82c6-466c-b18e-8d3c70589411 req-d75917af-0413-4328-b740-5650dbcccbcb tempest-TestStampPattern-1960194961 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-88f35ff4-5614-4d5a-9ac3-d7416714971f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0914938f-a0ce-4b60-8b5e-deb55213eb4b', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:50:10 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-a65e8c2c-82c6-466c-b18e-8d3c70589411 req-d75917af-0413-4328-b740-5650dbcccbcb tempest-TestStampPattern-1960194961 None] attachment_update completed successfully. Jul 24 09:50:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7502ca74-5786-4d35-a2cd-692f59a13d9c tempest-ProjectReaderTests-1850456274 None] Acquiring lock "cinder-aab04f6b-5fb8-4a95-bc57-bf27e9971950-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:50:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7502ca74-5786-4d35-a2cd-692f59a13d9c tempest-ProjectReaderTests-1850456274 None] Lock "cinder-aab04f6b-5fb8-4a95-bc57-bf27e9971950-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:50:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7502ca74-5786-4d35-a2cd-692f59a13d9c tempest-ProjectReaderTests-1850456274 None] Acquiring lock "cinder-quobyte-aab04f6b-5fb8-4a95-bc57-bf27e9971950" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:50:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7502ca74-5786-4d35-a2cd-692f59a13d9c tempest-ProjectReaderTests-1850456274 None] Lock "cinder-quobyte-aab04f6b-5fb8-4a95-bc57-bf27e9971950" acquired by "delete_volume" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:50:10 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfeea5d-839f-4f90-9868-cd3d0c1050ab]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:50:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7502ca74-5786-4d35-a2cd-692f59a13d9c tempest-ProjectReaderTests-1850456274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-aab04f6b-5fb8-4a95-bc57-bf27e9971950 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:10 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-aab04f6b-5fb8-4a95-bc57-bf27e9971950 Jul 24 09:50:10 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:11 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7502ca74-5786-4d35-a2cd-692f59a13d9c tempest-ProjectReaderTests-1850456274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-aab04f6b-5fb8-4a95-bc57-bf27e9971950" returned: 0 in 0.414s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7502ca74-5786-4d35-a2cd-692f59a13d9c tempest-ProjectReaderTests-1850456274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-aab04f6b-5fb8-4a95-bc57-bf27e9971950 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:11 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-aab04f6b-5fb8-4a95-bc57-bf27e9971950 Jul 24 09:50:11 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:11 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7502ca74-5786-4d35-a2cd-692f59a13d9c tempest-ProjectReaderTests-1850456274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-aab04f6b-5fb8-4a95-bc57-bf27e9971950" returned: 0 in 0.316s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7502ca74-5786-4d35-a2cd-692f59a13d9c tempest-ProjectReaderTests-1850456274 None] Lock "cinder-quobyte-aab04f6b-5fb8-4a95-bc57-bf27e9971950" released by "delete_volume" :: held 0.793s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:50:11 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-7502ca74-5786-4d35-a2cd-692f59a13d9c tempest-ProjectReaderTests-1850456274 None] Created reservations ['1ba4bf15-4e59-4311-a9ba-b8ac1fe2d292', 'e8a1c342-47e6-4df7-bb03-90e30e6da60b', '532c3b8b-9373-4315-ad76-313be089e030', 'e8494a25-37c5-40bf-8889-d0be3c9966e1'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:50:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7502ca74-5786-4d35-a2cd-692f59a13d9c tempest-ProjectReaderTests-1850456274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7502ca74-5786-4d35-a2cd-692f59a13d9c tempest-ProjectReaderTests-1850456274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7502ca74-5786-4d35-a2cd-692f59a13d9c tempest-ProjectReaderTests-1850456274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:50:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7502ca74-5786-4d35-a2cd-692f59a13d9c tempest-ProjectReaderTests-1850456274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:50:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7502ca74-5786-4d35-a2cd-692f59a13d9c tempest-ProjectReaderTests-1850456274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7502ca74-5786-4d35-a2cd-692f59a13d9c tempest-ProjectReaderTests-1850456274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:11 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:50:11 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:11 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7502ca74-5786-4d35-a2cd-692f59a13d9c tempest-ProjectReaderTests-1850456274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.275s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:11 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-7502ca74-5786-4d35-a2cd-692f59a13d9c tempest-ProjectReaderTests-1850456274 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:50:11 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-7502ca74-5786-4d35-a2cd-692f59a13d9c tempest-ProjectReaderTests-1850456274 None] Deleted volume successfully. Jul 24 09:50:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7502ca74-5786-4d35-a2cd-692f59a13d9c tempest-ProjectReaderTests-1850456274 None] Lock "cinder-aab04f6b-5fb8-4a95-bc57-bf27e9971950-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Flow 'volume_create_manager' (75b7f713-db5b-4577-bd9f-34592b995d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bede3666-713e-482b-a9f3-14ed14722049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bede3666-713e-482b-a9f3-14ed14722049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-567100166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84073e9c-8006-4f06-ac66-af0ef27643b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce447c2c3364ce0b03e232afeeafc88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:50:12Z,use_quota=True,user_id='e78e6300f9434913a2a283047fdb27a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a14832-d8de-4359-b365-3766cf9fd97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a14832-d8de-4359-b365-3766cf9fd97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e51515-ac8b-4f26-a432-1474d9d95f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e51515-ac8b-4f26-a432-1474d9d95f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84073e9c-8006-4f06-ac66-af0ef27643b4', 'volume_name': 'volume-84073e9c-8006-4f06-ac66-af0ef27643b4', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344dbf80-9896-45e3-b1a7-526bb06972a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344dbf80-9896-45e3-b1a7-526bb06972a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76f1ade-f43b-4a73-9771-e4bd38891c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:12 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Volume 84073e9c-8006-4f06-ac66-af0ef27643b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84073e9c-8006-4f06-ac66-af0ef27643b4', 'volume_size': 1} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-567100166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84073e9c-8006-4f06-ac66-af0ef27643b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce447c2c3364ce0b03e232afeeafc88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:50:12Z,use_quota=True,user_id='e78e6300f9434913a2a283047fdb27a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Creating volume 84073e9c-8006-4f06-ac66-af0ef27643b4 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:50:12 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-84073e9c-8006-4f06-ac66-af0ef27643b4 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:12 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-84073e9c-8006-4f06-ac66-af0ef27643b4 1073741824 Jul 24 09:50:12 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:12 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-84073e9c-8006-4f06-ac66-af0ef27643b4 1073741824" returned: 0 in 0.483s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-84073e9c-8006-4f06-ac66-af0ef27643b4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:12 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-84073e9c-8006-4f06-ac66-af0ef27643b4 Jul 24 09:50:12 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:13 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-84073e9c-8006-4f06-ac66-af0ef27643b4" returned: 0 in 0.259s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:50:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76f1ade-f43b-4a73-9771-e4bd38891c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84073e9c-8006-4f06-ac66-af0ef27643b4', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad7f0a1-38e6-4e2f-a4d4-ac1c4f197ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:13 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Volume volume-84073e9c-8006-4f06-ac66-af0ef27643b4 (84073e9c-8006-4f06-ac66-af0ef27643b4): created successfully Jul 24 09:50:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad7f0a1-38e6-4e2f-a4d4-ac1c4f197ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Flow 'volume_create_manager' (75b7f713-db5b-4577-bd9f-34592b995d2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:50:13 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-002f9008-43d2-4bbd-8a5d-a0e779f5f2ed tempest-ProjectReaderTests-1850456274 None] Created volume successfully. Jul 24 09:50:14 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b1a1ed17-0a81-4e22-93e7-b4ef5020533c tempest-ProjectReaderTests-1850456274 None] Acquiring lock "cinder-84073e9c-8006-4f06-ac66-af0ef27643b4-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:50:14 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b1a1ed17-0a81-4e22-93e7-b4ef5020533c tempest-ProjectReaderTests-1850456274 None] Lock "cinder-84073e9c-8006-4f06-ac66-af0ef27643b4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:50:14 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b1a1ed17-0a81-4e22-93e7-b4ef5020533c tempest-ProjectReaderTests-1850456274 None] Acquiring lock "cinder-quobyte-84073e9c-8006-4f06-ac66-af0ef27643b4" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:50:14 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b1a1ed17-0a81-4e22-93e7-b4ef5020533c tempest-ProjectReaderTests-1850456274 None] Lock "cinder-quobyte-84073e9c-8006-4f06-ac66-af0ef27643b4" acquired by "delete_volume" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:50:14 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff92b7d0-b553-4c9d-b81e-6232b87e2285]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:50:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b1a1ed17-0a81-4e22-93e7-b4ef5020533c tempest-ProjectReaderTests-1850456274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-84073e9c-8006-4f06-ac66-af0ef27643b4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:14 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-84073e9c-8006-4f06-ac66-af0ef27643b4 Jul 24 09:50:14 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:14 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b1a1ed17-0a81-4e22-93e7-b4ef5020533c tempest-ProjectReaderTests-1850456274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-84073e9c-8006-4f06-ac66-af0ef27643b4" returned: 0 in 0.373s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b1a1ed17-0a81-4e22-93e7-b4ef5020533c tempest-ProjectReaderTests-1850456274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-84073e9c-8006-4f06-ac66-af0ef27643b4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:14 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-84073e9c-8006-4f06-ac66-af0ef27643b4 Jul 24 09:50:14 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:15 devstack sudo[103784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:50:15 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:15 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b1a1ed17-0a81-4e22-93e7-b4ef5020533c tempest-ProjectReaderTests-1850456274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-84073e9c-8006-4f06-ac66-af0ef27643b4" returned: 0 in 0.258s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b1a1ed17-0a81-4e22-93e7-b4ef5020533c tempest-ProjectReaderTests-1850456274 None] Lock "cinder-quobyte-84073e9c-8006-4f06-ac66-af0ef27643b4" released by "delete_volume" :: held 0.680s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-b1a1ed17-0a81-4e22-93e7-b4ef5020533c tempest-ProjectReaderTests-1850456274 None] Created reservations ['f6484e8e-9e6b-4e5f-81de-b562fc474850', 'd93ea7a2-be29-46a8-9a9d-f055260bb302', '475e22d4-4566-4c2f-9733-06c257d4bd9f', 'b16dd0af-4568-48ff-91f0-48cd90d8dafe'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b1a1ed17-0a81-4e22-93e7-b4ef5020533c tempest-ProjectReaderTests-1850456274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b1a1ed17-0a81-4e22-93e7-b4ef5020533c tempest-ProjectReaderTests-1850456274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b1a1ed17-0a81-4e22-93e7-b4ef5020533c tempest-ProjectReaderTests-1850456274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b1a1ed17-0a81-4e22-93e7-b4ef5020533c tempest-ProjectReaderTests-1850456274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b1a1ed17-0a81-4e22-93e7-b4ef5020533c tempest-ProjectReaderTests-1850456274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b1a1ed17-0a81-4e22-93e7-b4ef5020533c tempest-ProjectReaderTests-1850456274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:15 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:50:15 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:15 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.319s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 28 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:50:15 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b1a1ed17-0a81-4e22-93e7-b4ef5020533c tempest-ProjectReaderTests-1850456274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.257s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-b1a1ed17-0a81-4e22-93e7-b4ef5020533c tempest-ProjectReaderTests-1850456274 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:50:15 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b1a1ed17-0a81-4e22-93e7-b4ef5020533c tempest-ProjectReaderTests-1850456274 None] Deleted volume successfully. Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b1a1ed17-0a81-4e22-93e7-b4ef5020533c tempest-ProjectReaderTests-1850456274 None] Lock "cinder-84073e9c-8006-4f06-ac66-af0ef27643b4-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:50:15 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-2a878460-d008-42ad-ac6d-0d598db09d8f req-6d16ca58-c01a-43ad-ad3a-e7c45eef1dec tempest-TestStampPattern-1960194961 None] Terminate volume connection completed successfully. Jul 24 09:50:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-2a878460-d008-42ad-ac6d-0d598db09d8f req-6d16ca58-c01a-43ad-ad3a-e7c45eef1dec tempest-TestStampPattern-1960194961 None] Deleting attachment 0914938f-a0ce-4b60-8b5e-deb55213eb4b. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:50:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-06c117e7-29cb-4f1b-924f-a0e5e72fc7b3 tempest-TestStampPattern-1960194961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-06c117e7-29cb-4f1b-924f-a0e5e72fc7b3 tempest-TestStampPattern-1960194961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-06c117e7-29cb-4f1b-924f-a0e5e72fc7b3 tempest-TestStampPattern-1960194961 None] Creating offline snapshot 9608d83d-dc02-4a5d-8af5-d1658548d06b of volume 88f35ff4-5614-4d5a-9ac3-d7416714971f {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:50:16 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb2fd96-b708-402a-88da-96b314e526c7]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:50:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06c117e7-29cb-4f1b-924f-a0e5e72fc7b3 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:16 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f Jul 24 09:50:16 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:16 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06c117e7-29cb-4f1b-924f-a0e5e72fc7b3 tempest-TestStampPattern-1960194961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f" returned: 0 in 0.393s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06c117e7-29cb-4f1b-924f-a0e5e72fc7b3 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:17 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b 1G Jul 24 09:50:17 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:17 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06c117e7-29cb-4f1b-924f-a0e5e72fc7b3 tempest-TestStampPattern-1960194961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b 1G" returned: 0 in 0.391s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06c117e7-29cb-4f1b-924f-a0e5e72fc7b3 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f35ff4-5614-4d5a-9ac3-d7416714971f -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:17 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f35ff4-5614-4d5a-9ac3-d7416714971f -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b Jul 24 09:50:17 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:17 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06c117e7-29cb-4f1b-924f-a0e5e72fc7b3 tempest-TestStampPattern-1960194961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f35ff4-5614-4d5a-9ac3-d7416714971f -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b" returned: 0 in 0.278s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:17 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-06c117e7-29cb-4f1b-924f-a0e5e72fc7b3 tempest-TestStampPattern-1960194961 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b is being set with open permissions: ugo+rw Jul 24 09:50:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06c117e7-29cb-4f1b-924f-a0e5e72fc7b3 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:17 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b Jul 24 09:50:17 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:17 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06c117e7-29cb-4f1b-924f-a0e5e72fc7b3 tempest-TestStampPattern-1960194961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b" returned: 0 in 0.243s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06c117e7-29cb-4f1b-924f-a0e5e72fc7b3 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:17 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.info Jul 24 09:50:17 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:18 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06c117e7-29cb-4f1b-924f-a0e5e72fc7b3 tempest-TestStampPattern-1960194961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.info" returned: 0 in 0.247s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:18 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-06c117e7-29cb-4f1b-924f-a0e5e72fc7b3 tempest-TestStampPattern-1960194961 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.info is being set with open permissions: ugo+rw Jul 24 09:50:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06c117e7-29cb-4f1b-924f-a0e5e72fc7b3 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:18 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.info Jul 24 09:50:18 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:18 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06c117e7-29cb-4f1b-924f-a0e5e72fc7b3 tempest-TestStampPattern-1960194961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.info" returned: 0 in 0.242s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-06c117e7-29cb-4f1b-924f-a0e5e72fc7b3 tempest-TestStampPattern-1960194961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.878s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:18 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-06c117e7-29cb-4f1b-924f-a0e5e72fc7b3 tempest-TestStampPattern-1960194961 None] Create snapshot completed successfully Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=86,cinder:UPDATE=119,cinder:DELETE=14,cinder:INSERT=29 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Flow 'volume_create_manager' (a9b8e159-9c7b-420a-a552-d305783e5ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645f1c59-300c-46d8-8782-688a1b55427f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645f1c59-300c-46d8-8782-688a1b55427f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1448650029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846562ebdcbf4c9984fac124c08aff74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:50:24Z,use_quota=True,user_id='8f6b934209e3473189cc0f6c0691f36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c973af1-0100-4097-8348-e7048cd1c0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c973af1-0100-4097-8348-e7048cd1c0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d57891-3351-46a2-a1eb-6c57308f45b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d57891-3351-46a2-a1eb-6c57308f45b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291', 'volume_name': 'volume-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4569fd-e38c-4d27-ae8e-0994c138f484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4569fd-e38c-4d27-ae8e-0994c138f484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6421a9d7-ba64-4ba8-a6d6-be2cd7cee902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:24 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Volume 5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291', 'volume_size': 1} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1448650029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846562ebdcbf4c9984fac124c08aff74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:50:24Z,use_quota=True,user_id='8f6b934209e3473189cc0f6c0691f36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Creating volume 5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:50:24 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:24 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291 1073741824 Jul 24 09:50:24 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:24 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291 1073741824" returned: 0 in 0.469s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:24 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291 Jul 24 09:50:24 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:25 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291" returned: 0 in 0.249s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6421a9d7-ba64-4ba8-a6d6-be2cd7cee902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f819ece6-331d-4ae1-ac7c-04b303e2ca3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:25 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Volume volume-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291 (5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291): created successfully Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f819ece6-331d-4ae1-ac7c-04b303e2ca3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Flow 'volume_create_manager' (a9b8e159-9c7b-420a-a552-d305783e5ca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:50:25 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-7c4529b9-24db-46b9-87e0-fcb136d38d8b tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Created volume successfully. Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=133,cinder:SELECT=101,cinder:INSERT=29,cinder:DELETE=9 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Flow 'volume_create_manager' (256294f4-4959-4ab0-8aba-e1e76596b64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72bd5707-68ed-4cad-801c-86b815ee2022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72bd5707-68ed-4cad-801c-86b815ee2022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-794925399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c0fb172-119d-4a06-8c86-93736e850022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019d3e4f039e49cc8120a113657efe35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9608d83d-dc02-4a5d-8af5-d1658548d06b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:50:25Z,use_quota=True,user_id='157c2b35abb648999dc23e8232b0fc8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd26dae-b946-41f3-ab03-8f2a2a446f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd26dae-b946-41f3-ab03-8f2a2a446f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9e5b7f-31c0-4312-a2b6-32bfb3907b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9e5b7f-31c0-4312-a2b6-32bfb3907b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7c0fb172-119d-4a06-8c86-93736e850022', 'volume_name': 'volume-7c0fb172-119d-4a06-8c86-93736e850022', 'volume_size': 1, 'snapshot_id': '9608d83d-dc02-4a5d-8af5-d1658548d06b'}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26ca52c-eccb-4a8a-a5c3-67a1497f52d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26ca52c-eccb-4a8a-a5c3-67a1497f52d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe421dd-5781-4b14-96ac-a39b32aa7a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:25 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Volume 7c0fb172-119d-4a06-8c86-93736e850022: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7c0fb172-119d-4a06-8c86-93736e850022', 'volume_size': 1, 'snapshot_id': '9608d83d-dc02-4a5d-8af5-d1658548d06b'} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Acquiring lock "cinder-quobyte-9608d83d-dc02-4a5d-8af5-d1658548d06b-7c0fb172-119d-4a06-8c86-93736e850022" by "_create_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Lock "cinder-quobyte-9608d83d-dc02-4a5d-8af5-d1658548d06b-7c0fb172-119d-4a06-8c86-93736e850022" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Creating volume 7c0fb172-119d-4a06-8c86-93736e850022 from snapshot 9608d83d-dc02-4a5d-8af5-d1658548d06b {{(pid=88488) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Acquiring lock "cinder-quobyte-7c0fb172-119d-4a06-8c86-93736e850022" by "_copy_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Lock "cinder-quobyte-7c0fb172-119d-4a06-8c86-93736e850022" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] snapshot: 9608d83d-dc02-4a5d-8af5-d1658548d06b, volume: 7c0fb172-119d-4a06-8c86-93736e850022, {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e5a368-b7e8-4874-8a6b-271666562a32]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:25 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b Jul 24 09:50:25 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:25 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b" returned: 0 in 0.359s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88f35ff4-5614-4d5a-9ac3-d7416714971f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Creating direct copy from snapshot {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad297f59-ce17-48c1-b596-7cf2d497ae50]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:50:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:26 devstack sudo[103940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f Jul 24 09:50:26 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:26 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f" returned: 0 in 0.485s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:26 devstack cinder-volume[88488]: DEBUG cinder.utils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Path /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7c0fb172-119d-4a06-8c86-93736e850022 not found in is_blk_device check {{(pid=88488) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 09:50:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7c0fb172-119d-4a06-8c86-93736e850022 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:26 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7c0fb172-119d-4a06-8c86-93736e850022 Jul 24 09:50:26 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-de0d8c6a-4b31-4781-9e58-1cf33aacae48 req-b5d66ebf-7977-4e2d-ae4d-ef38032878d0 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:32 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7c0fb172-119d-4a06-8c86-93736e850022" returned: 0 in 5.841s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:32 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e48cce7-9c2c-4ca5-99f6-055db8f8af7b]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:50:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:32 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f Jul 24 09:50:32 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:32 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f" returned: 0 in 0.621s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:32 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7c0fb172-119d-4a06-8c86-93736e850022 {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:50:32 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Converted 1024.00 MB image at 175.28 MB/s Jul 24 09:50:32 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7c0fb172-119d-4a06-8c86-93736e850022 is being set with open permissions: ugo+rw Jul 24 09:50:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7c0fb172-119d-4a06-8c86-93736e850022 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:32 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7c0fb172-119d-4a06-8c86-93736e850022 Jul 24 09:50:32 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:33 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7c0fb172-119d-4a06-8c86-93736e850022" returned: 0 in 0.252s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Lock "cinder-quobyte-7c0fb172-119d-4a06-8c86-93736e850022" released by "_copy_volume_from_snapshot" :: held 7.659s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:50:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Lock "cinder-quobyte-9608d83d-dc02-4a5d-8af5-d1658548d06b-7c0fb172-119d-4a06-8c86-93736e850022" released by "_create_volume_from_snapshot" :: held 7.689s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:50:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.705s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-de0d8c6a-4b31-4781-9e58-1cf33aacae48 req-b5d66ebf-7977-4e2d-ae4d-ef38032878d0 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.116s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-de0d8c6a-4b31-4781-9e58-1cf33aacae48 req-b5d66ebf-7977-4e2d-ae4d-ef38032878d0 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe421dd-5781-4b14-96ac-a39b32aa7a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c0fb172-119d-4a06-8c86-93736e850022', 'volume_size': 1, 'snapshot_id': '9608d83d-dc02-4a5d-8af5-d1658548d06b'}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa843a4-2133-4bf7-850b-657a8df28622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:50:33 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Volume volume-7c0fb172-119d-4a06-8c86-93736e850022 (7c0fb172-119d-4a06-8c86-93736e850022): created successfully Jul 24 09:50:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa843a4-2133-4bf7-850b-657a8df28622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:50:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Flow 'volume_create_manager' (256294f4-4959-4ab0-8aba-e1e76596b64f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:50:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-de0d8c6a-4b31-4781-9e58-1cf33aacae48 req-b5d66ebf-7977-4e2d-ae4d-ef38032878d0 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78d78dc5-3062-4a79-9001-f74c24815ea4', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:50:33 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-f13ffe8e-66fe-4823-81b0-1573388fcb35 tempest-TestStampPattern-1960194961 None] Created volume successfully. Jul 24 09:50:33 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-de0d8c6a-4b31-4781-9e58-1cf33aacae48 req-b5d66ebf-7977-4e2d-ae4d-ef38032878d0 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] attachment_update completed successfully. Jul 24 09:50:36 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-3446d851-04a9-43ec-a2b0-92cf62dfaeaa req-affea36d-70d2-4a7e-aa0f-6077de660506 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Terminate volume connection completed successfully. Jul 24 09:50:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-3446d851-04a9-43ec-a2b0-92cf62dfaeaa req-affea36d-70d2-4a7e-aa0f-6077de660506 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Deleting attachment 78d78dc5-3062-4a79-9001-f74c24815ea4. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:50:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4907a043-b584-4451-8759-83f65bcd00a3 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Acquiring lock "cinder-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:50:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4907a043-b584-4451-8759-83f65bcd00a3 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Lock "cinder-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:50:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4907a043-b584-4451-8759-83f65bcd00a3 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Acquiring lock "cinder-quobyte-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:50:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4907a043-b584-4451-8759-83f65bcd00a3 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Lock "cinder-quobyte-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:50:37 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[595c0728-dd2f-493d-a720-de478e9868f5]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:50:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4907a043-b584-4451-8759-83f65bcd00a3 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:37 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291 Jul 24 09:50:37 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:38 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4907a043-b584-4451-8759-83f65bcd00a3 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291" returned: 0 in 0.382s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4907a043-b584-4451-8759-83f65bcd00a3 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:38 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291 Jul 24 09:50:38 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:38 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4907a043-b584-4451-8759-83f65bcd00a3 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291" returned: 0 in 0.316s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4907a043-b584-4451-8759-83f65bcd00a3 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Lock "cinder-quobyte-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291" released by "delete_volume" :: held 0.754s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:50:38 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-4907a043-b584-4451-8759-83f65bcd00a3 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Created reservations ['78155308-ac40-408b-9602-c7d5e407a948', '97b5b08d-2106-4756-8d95-8a34955ca6d2', '7e71dc4c-addc-48f1-a2d1-1301b084484d', '91389bc4-6377-48bd-9656-0051d31144e2'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:50:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4907a043-b584-4451-8759-83f65bcd00a3 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:50:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4907a043-b584-4451-8759-83f65bcd00a3 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:50:38 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4907a043-b584-4451-8759-83f65bcd00a3 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:50:38 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4907a043-b584-4451-8759-83f65bcd00a3 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:50:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4907a043-b584-4451-8759-83f65bcd00a3 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:50:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4907a043-b584-4451-8759-83f65bcd00a3 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:50:38 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:50:38 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:50:38 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Jul 24 09:50:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4907a043-b584-4451-8759-83f65bcd00a3 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.377s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:50:38 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-4907a043-b584-4451-8759-83f65bcd00a3 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:50:39 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-4907a043-b584-4451-8759-83f65bcd00a3 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Deleted volume successfully. Jul 24 09:50:39 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4907a043-b584-4451-8759-83f65bcd00a3 tempest-TestServerVolumeAttachScenarioOldVersion-1556637629 None] Lock "cinder-5cfa3b7e-b9fb-4aa8-9b5f-bf6f5ed8a291-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:50:48 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=15,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:50:49 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=16,cinder:UPDATE=11,cinder:DELETE=3,cinder:INSERT=2 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Flow 'volume_create_manager' (a96c408b-7a20-4ed5-92f4-14e8868fd752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b16783f-9682-4d6e-b744-788488680f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b16783f-9682-4d6e-b744-788488680f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-500014685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300cff55-dd39-40cd-8045-de4a09599627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e05f25ef211485ba1bfd013ecf610b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:51:10Z,use_quota=True,user_id='8c84d73d1e0b4c4494d1b5beb355eb2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d46905-9711-4b4e-828f-36c790b6d797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d46905-9711-4b4e-828f-36c790b6d797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (440f6f90-366e-45bd-9bbd-a6fd49afec83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (440f6f90-366e-45bd-9bbd-a6fd49afec83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '300cff55-dd39-40cd-8045-de4a09599627', 'volume_name': 'volume-300cff55-dd39-40cd-8045-de4a09599627', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f068c3-3db0-4dfd-ba2c-f6a0c5581f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f068c3-3db0-4dfd-ba2c-f6a0c5581f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c432cfe-2973-4154-910c-777371caf580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:10 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Volume 300cff55-dd39-40cd-8045-de4a09599627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-300cff55-dd39-40cd-8045-de4a09599627', 'volume_size': 1} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-500014685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300cff55-dd39-40cd-8045-de4a09599627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e05f25ef211485ba1bfd013ecf610b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:51:10Z,use_quota=True,user_id='8c84d73d1e0b4c4494d1b5beb355eb2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Creating volume 300cff55-dd39-40cd-8045-de4a09599627 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:51:10 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-300cff55-dd39-40cd-8045-de4a09599627 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:10 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-300cff55-dd39-40cd-8045-de4a09599627 1073741824 Jul 24 09:51:10 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Flow 'volume_create_manager' (3a9790a1-5222-4841-9d1c-6a0893c4d3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb374d6e-9a2d-4735-8c79-ee34083090d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb374d6e-9a2d-4735-8c79-ee34083090d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2085452863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=574072a5-0cc9-4989-b565-0a2caf3316ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e05f25ef211485ba1bfd013ecf610b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:51:10Z,use_quota=True,user_id='8c84d73d1e0b4c4494d1b5beb355eb2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c1d928-277e-4310-af0e-0574806746b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c1d928-277e-4310-af0e-0574806746b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b4be82-05d8-4a3b-8041-15ab5979f117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b4be82-05d8-4a3b-8041-15ab5979f117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '574072a5-0cc9-4989-b565-0a2caf3316ea', 'volume_name': 'volume-574072a5-0cc9-4989-b565-0a2caf3316ea', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4e3119-1bc8-4441-97f6-7c90f90c95e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4e3119-1bc8-4441-97f6-7c90f90c95e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58987d7f-cfbe-4cd9-81e8-5bf82f566f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:10 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Volume 574072a5-0cc9-4989-b565-0a2caf3316ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-574072a5-0cc9-4989-b565-0a2caf3316ea', 'volume_size': 1} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:51:10 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-300cff55-dd39-40cd-8045-de4a09599627 1073741824" returned: 0 in 0.478s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-300cff55-dd39-40cd-8045-de4a09599627 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:10 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-300cff55-dd39-40cd-8045-de4a09599627 Jul 24 09:51:10 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:10 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-300cff55-dd39-40cd-8045-de4a09599627" returned: 0 in 0.272s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.466s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2085452863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=574072a5-0cc9-4989-b565-0a2caf3316ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e05f25ef211485ba1bfd013ecf610b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:51:10Z,use_quota=True,user_id='8c84d73d1e0b4c4494d1b5beb355eb2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Creating volume 574072a5-0cc9-4989-b565-0a2caf3316ea {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:51:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:51:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:51:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:51:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:51:11 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:51:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-574072a5-0cc9-4989-b565-0a2caf3316ea 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c432cfe-2973-4154-910c-777371caf580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-300cff55-dd39-40cd-8045-de4a09599627', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c940586-28c5-4f91-97e7-4f118a4cf829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:11 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-574072a5-0cc9-4989-b565-0a2caf3316ea 1073741824 Jul 24 09:51:11 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:11 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Volume volume-300cff55-dd39-40cd-8045-de4a09599627 (300cff55-dd39-40cd-8045-de4a09599627): created successfully Jul 24 09:51:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c940586-28c5-4f91-97e7-4f118a4cf829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Flow 'volume_create_manager' (a96c408b-7a20-4ed5-92f4-14e8868fd752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:51:11 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-7659751e-76ec-49a0-8c07-738b3ae371c4 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Created volume successfully. Jul 24 09:51:11 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-574072a5-0cc9-4989-b565-0a2caf3316ea 1073741824" returned: 0 in 0.486s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-574072a5-0cc9-4989-b565-0a2caf3316ea {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:11 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-574072a5-0cc9-4989-b565-0a2caf3316ea Jul 24 09:51:11 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:11 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-574072a5-0cc9-4989-b565-0a2caf3316ea" returned: 0 in 0.241s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:51:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:51:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58987d7f-cfbe-4cd9-81e8-5bf82f566f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-574072a5-0cc9-4989-b565-0a2caf3316ea', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe2a8bf-8c62-4e18-b4ae-fbd2968bc98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:11 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Volume volume-574072a5-0cc9-4989-b565-0a2caf3316ea (574072a5-0cc9-4989-b565-0a2caf3316ea): created successfully Jul 24 09:51:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe2a8bf-8c62-4e18-b4ae-fbd2968bc98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Flow 'volume_create_manager' (3a9790a1-5222-4841-9d1c-6a0893c4d3c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:51:11 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-cfdddd0f-c6af-4ef7-b867-20b9f234dcf9 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Created volume successfully. Jul 24 09:51:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:51:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:51:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:51:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:51:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:51:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:51:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:15 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:51:15 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:15 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.364s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:51:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:51:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 28 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:51:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:51:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-48d55b4c-93b6-41f9-a4cd-30245c220915 req-e2a82210-0a86-4d6f-aabc-b02bfb500d34 tempest-TestStampPattern-1960194961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:51:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-48d55b4c-93b6-41f9-a4cd-30245c220915 req-e2a82210-0a86-4d6f-aabc-b02bfb500d34 tempest-TestStampPattern-1960194961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:51:15 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[951a2699-977e-4ed9-95e3-62e6b7cd786e]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:51:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-48d55b4c-93b6-41f9-a4cd-30245c220915 req-e2a82210-0a86-4d6f-aabc-b02bfb500d34 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7c0fb172-119d-4a06-8c86-93736e850022 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:15 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7c0fb172-119d-4a06-8c86-93736e850022 Jul 24 09:51:15 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:16 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [req-48d55b4c-93b6-41f9-a4cd-30245c220915 req-e2a82210-0a86-4d6f-aabc-b02bfb500d34 tempest-TestStampPattern-1960194961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7c0fb172-119d-4a06-8c86-93736e850022" returned: 0 in 0.380s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-48d55b4c-93b6-41f9-a4cd-30245c220915 req-e2a82210-0a86-4d6f-aabc-b02bfb500d34 tempest-TestStampPattern-1960194961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.408s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:51:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-48d55b4c-93b6-41f9-a4cd-30245c220915 req-e2a82210-0a86-4d6f-aabc-b02bfb500d34 tempest-TestStampPattern-1960194961 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-7c0fb172-119d-4a06-8c86-93736e850022', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bef5e9a2-d6d7-4a86-a1ea-f1a2c0faedf4', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:51:16 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-48d55b4c-93b6-41f9-a4cd-30245c220915 req-e2a82210-0a86-4d6f-aabc-b02bfb500d34 tempest-TestStampPattern-1960194961 None] attachment_update completed successfully. Jul 24 09:51:19 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-197b4882-5465-434d-94d1-170b4a6eefeb req-5eb1a992-1fbe-4174-8a0c-8aee9e113064 tempest-TestStampPattern-1960194961 None] Terminate volume connection completed successfully. Jul 24 09:51:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-197b4882-5465-434d-94d1-170b4a6eefeb req-5eb1a992-1fbe-4174-8a0c-8aee9e113064 tempest-TestStampPattern-1960194961 None] Deleting attachment bef5e9a2-d6d7-4a86-a1ea-f1a2c0faedf4. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:51:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5cc993cc-6f93-40d8-a31f-1e19227cb90d tempest-TestStampPattern-1960194961 None] Acquiring lock "cinder-7c0fb172-119d-4a06-8c86-93736e850022-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:51:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5cc993cc-6f93-40d8-a31f-1e19227cb90d tempest-TestStampPattern-1960194961 None] Lock "cinder-7c0fb172-119d-4a06-8c86-93736e850022-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:51:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5cc993cc-6f93-40d8-a31f-1e19227cb90d tempest-TestStampPattern-1960194961 None] Acquiring lock "cinder-quobyte-7c0fb172-119d-4a06-8c86-93736e850022" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:51:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5cc993cc-6f93-40d8-a31f-1e19227cb90d tempest-TestStampPattern-1960194961 None] Lock "cinder-quobyte-7c0fb172-119d-4a06-8c86-93736e850022" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:51:25 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad24090-399c-419f-bba5-9577c4842e21]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:51:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5cc993cc-6f93-40d8-a31f-1e19227cb90d tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7c0fb172-119d-4a06-8c86-93736e850022 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:25 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7c0fb172-119d-4a06-8c86-93736e850022 Jul 24 09:51:25 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:25 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5cc993cc-6f93-40d8-a31f-1e19227cb90d tempest-TestStampPattern-1960194961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7c0fb172-119d-4a06-8c86-93736e850022" returned: 0 in 0.360s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5cc993cc-6f93-40d8-a31f-1e19227cb90d tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7c0fb172-119d-4a06-8c86-93736e850022 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:25 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7c0fb172-119d-4a06-8c86-93736e850022 Jul 24 09:51:25 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:25 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5cc993cc-6f93-40d8-a31f-1e19227cb90d tempest-TestStampPattern-1960194961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-7c0fb172-119d-4a06-8c86-93736e850022" returned: 0 in 0.246s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5cc993cc-6f93-40d8-a31f-1e19227cb90d tempest-TestStampPattern-1960194961 None] Lock "cinder-quobyte-7c0fb172-119d-4a06-8c86-93736e850022" released by "delete_volume" :: held 0.650s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:51:26 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-5cc993cc-6f93-40d8-a31f-1e19227cb90d tempest-TestStampPattern-1960194961 None] Created reservations ['f9fd191c-6f0c-4b4f-a597-0c852b302fc4', '6df1d531-92bb-43e4-9c5f-a61ae07c0882', 'bbc65cdf-8d4a-46bc-82ac-3056e80c0b00', 'd315f5f8-1467-42ea-a17d-ef947138aa9d'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:51:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5cc993cc-6f93-40d8-a31f-1e19227cb90d tempest-TestStampPattern-1960194961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:51:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5cc993cc-6f93-40d8-a31f-1e19227cb90d tempest-TestStampPattern-1960194961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:51:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-5cc993cc-6f93-40d8-a31f-1e19227cb90d tempest-TestStampPattern-1960194961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:51:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-5cc993cc-6f93-40d8-a31f-1e19227cb90d tempest-TestStampPattern-1960194961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:51:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5cc993cc-6f93-40d8-a31f-1e19227cb90d tempest-TestStampPattern-1960194961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:51:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5cc993cc-6f93-40d8-a31f-1e19227cb90d tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:26 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:51:26 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:26 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5cc993cc-6f93-40d8-a31f-1e19227cb90d tempest-TestStampPattern-1960194961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.252s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:26 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-5cc993cc-6f93-40d8-a31f-1e19227cb90d tempest-TestStampPattern-1960194961 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:51:26 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-5cc993cc-6f93-40d8-a31f-1e19227cb90d tempest-TestStampPattern-1960194961 None] Deleted volume successfully. Jul 24 09:51:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5cc993cc-6f93-40d8-a31f-1e19227cb90d tempest-TestStampPattern-1960194961 None] Lock "cinder-7c0fb172-119d-4a06-8c86-93736e850022-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:51:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] Acquiring lock "cinder-9608d83d-dc02-4a5d-8af5-d1658548d06b-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:51:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] Lock "cinder-9608d83d-dc02-4a5d-8af5-d1658548d06b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:51:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] Acquiring lock "cinder-quobyte-88f35ff4-5614-4d5a-9ac3-d7416714971f" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:51:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] Lock "cinder-quobyte-88f35ff4-5614-4d5a-9ac3-d7416714971f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:51:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] Acquiring lock "cinder-quobyte-9608d83d-dc02-4a5d-8af5-d1658548d06b" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:51:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] Lock "cinder-quobyte-9608d83d-dc02-4a5d-8af5-d1658548d06b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:51:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] Deleting offline snapshot 9608d83d-dc02-4a5d-8af5-d1658548d06b of volume 88f35ff4-5614-4d5a-9ac3-d7416714971f {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:51:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] snapshot_file for this snap is: volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:51:26 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4fc3aa-2c47-4b7a-80f7-3496578b670e]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:51:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:26 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b Jul 24 09:51:26 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:27 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b" returned: 0 in 0.355s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88f35ff4-5614-4d5a-9ac3-d7416714971f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:51:27 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[068d2017-4570-4ed5-ba2c-952601e05131]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:51:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:27 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f Jul 24 09:51:27 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:27 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f" returned: 0 in 0.361s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:27 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b Jul 24 09:51:27 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:27 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b" returned: 0 in 0.335s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:27 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b Jul 24 09:51:27 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:28 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f.9608d83d-dc02-4a5d-8af5-d1658548d06b" returned: 0 in 0.242s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] Lock "cinder-quobyte-9608d83d-dc02-4a5d-8af5-d1658548d06b" released by "_delete_snapshot" :: held 1.388s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:51:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] Lock "cinder-quobyte-88f35ff4-5614-4d5a-9ac3-d7416714971f" released by "delete_snapshot" :: held 1.408s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:51:28 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] Created reservations ['3599745f-3a46-4fd0-b11b-0ca965210701', '27d703fc-b825-4d7b-86c4-19c885dd1d11', '769e4a2f-f668-4e22-926c-be6f73f4e452', 'c52ffea0-ffcc-4191-81ad-4606a42b4249'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:51:28 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] Delete snapshot completed successfully. Jul 24 09:51:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3d86b958-596e-4566-9b57-4c358249be23 tempest-TestStampPattern-1960194961 None] Lock "cinder-9608d83d-dc02-4a5d-8af5-d1658548d06b-delete_snapshot" released by "delete_snapshot" :: held 1.566s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:51:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-86aa2b28-1cce-4c96-aaed-f5dae42c1ce5 tempest-TestStampPattern-1960194961 None] Acquiring lock "cinder-88f35ff4-5614-4d5a-9ac3-d7416714971f-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:51:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-86aa2b28-1cce-4c96-aaed-f5dae42c1ce5 tempest-TestStampPattern-1960194961 None] Lock "cinder-88f35ff4-5614-4d5a-9ac3-d7416714971f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:51:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-86aa2b28-1cce-4c96-aaed-f5dae42c1ce5 tempest-TestStampPattern-1960194961 None] Acquiring lock "cinder-quobyte-88f35ff4-5614-4d5a-9ac3-d7416714971f" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:51:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-86aa2b28-1cce-4c96-aaed-f5dae42c1ce5 tempest-TestStampPattern-1960194961 None] Lock "cinder-quobyte-88f35ff4-5614-4d5a-9ac3-d7416714971f" acquired by "delete_volume" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:51:32 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2b5599-ccd3-41f1-848a-38babeaec00e]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:51:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-86aa2b28-1cce-4c96-aaed-f5dae42c1ce5 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:32 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f Jul 24 09:51:32 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:32 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-86aa2b28-1cce-4c96-aaed-f5dae42c1ce5 tempest-TestStampPattern-1960194961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f" returned: 0 in 0.338s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-86aa2b28-1cce-4c96-aaed-f5dae42c1ce5 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:32 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f Jul 24 09:51:32 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:33 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-86aa2b28-1cce-4c96-aaed-f5dae42c1ce5 tempest-TestStampPattern-1960194961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-88f35ff4-5614-4d5a-9ac3-d7416714971f" returned: 0 in 0.238s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-86aa2b28-1cce-4c96-aaed-f5dae42c1ce5 tempest-TestStampPattern-1960194961 None] Lock "cinder-quobyte-88f35ff4-5614-4d5a-9ac3-d7416714971f" released by "delete_volume" :: held 0.633s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:51:33 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-86aa2b28-1cce-4c96-aaed-f5dae42c1ce5 tempest-TestStampPattern-1960194961 None] Created reservations ['f30f3e88-36d4-4463-8e5a-37305e978592', 'd6fb6ddb-8abd-4336-8bcf-ef37549822ea', '5d20037a-e579-4143-a3a2-d7266fe9e398', '735c3209-edb9-44b5-a1c7-f74eeba2ac66'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:51:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-86aa2b28-1cce-4c96-aaed-f5dae42c1ce5 tempest-TestStampPattern-1960194961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:51:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-86aa2b28-1cce-4c96-aaed-f5dae42c1ce5 tempest-TestStampPattern-1960194961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:51:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-86aa2b28-1cce-4c96-aaed-f5dae42c1ce5 tempest-TestStampPattern-1960194961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:51:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-86aa2b28-1cce-4c96-aaed-f5dae42c1ce5 tempest-TestStampPattern-1960194961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:51:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-86aa2b28-1cce-4c96-aaed-f5dae42c1ce5 tempest-TestStampPattern-1960194961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:51:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-86aa2b28-1cce-4c96-aaed-f5dae42c1ce5 tempest-TestStampPattern-1960194961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:33 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:51:33 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:33 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-86aa2b28-1cce-4c96-aaed-f5dae42c1ce5 tempest-TestStampPattern-1960194961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.240s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:33 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-86aa2b28-1cce-4c96-aaed-f5dae42c1ce5 tempest-TestStampPattern-1960194961 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:51:33 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-86aa2b28-1cce-4c96-aaed-f5dae42c1ce5 tempest-TestStampPattern-1960194961 None] Deleted volume successfully. Jul 24 09:51:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-86aa2b28-1cce-4c96-aaed-f5dae42c1ce5 tempest-TestStampPattern-1960194961 None] Lock "cinder-88f35ff4-5614-4d5a-9ac3-d7416714971f-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:51:43 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=29,cinder:SELECT=25,cinder:INSERT=8 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:51:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-027a0426-4282-4efe-ac53-10ddf6fd50c7 req-5c2fa040-d6b9-4045-9211-5c722370d209 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:51:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-027a0426-4282-4efe-ac53-10ddf6fd50c7 req-5c2fa040-d6b9-4045-9211-5c722370d209 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:51:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-027a0426-4282-4efe-ac53-10ddf6fd50c7 req-5c2fa040-d6b9-4045-9211-5c722370d209 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:51:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-027a0426-4282-4efe-ac53-10ddf6fd50c7 req-5c2fa040-d6b9-4045-9211-5c722370d209 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-300cff55-dd39-40cd-8045-de4a09599627', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'deb44249-ceb2-4baa-aa24-31297e19f289', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:51:43 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-027a0426-4282-4efe-ac53-10ddf6fd50c7 req-5c2fa040-d6b9-4045-9211-5c722370d209 tempest-TestServerVolumeAttachmentScenario-2066771404 None] attachment_update completed successfully. Jul 24 09:51:46 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:51:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Flow 'volume_create_manager' (8be4418f-d431-4ee5-8240-2f3ba25a05a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:51:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fc70a3-4b09-458b-af64-3de4027fa47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fc70a3-4b09-458b-af64-3de4027fa47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283189f8-4d1a-4760-b781-6dd5c3be771a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb043dffd3d64106be6253316b1fa5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:51:46Z,use_quota=True,user_id='160d51df938f49f29ee9a2b6270966a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28767bc-e274-4627-a241-ed17a5703f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28767bc-e274-4627-a241-ed17a5703f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498df133-1a79-4ea4-839c-032b13f0acee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:46 devstack cinder-volume[88488]: DEBUG cinder.image.glance [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Creating Keystone auth plugin from conf {{(pid=88488) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 09:51:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498df133-1a79-4ea4-839c-032b13f0acee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '283189f8-4d1a-4760-b781-6dd5c3be771a', 'volume_name': 'volume-283189f8-4d1a-4760-b781-6dd5c3be771a', 'volume_size': 1, 'image_id': '45c7198a-be6c-4646-8def-e3201fefd743', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45c7198a-be6c-4646-8def-e3201fefd743', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e13a26d36045bf5e29a2393492ac3e0d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb043dffd3d64106be6253316b1fa5b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '82c26e73afe8f632cae58ae86504b5107220eca8eadc55200c64e2240bfab1cc20323ca98c7eeda810c96d80c08ae3cc529bcb32c99496cbe708d81a2d1974d9', 'id': '45c7198a-be6c-4646-8def-e3201fefd743', 'created_at': datetime.datetime(2026, 7, 24, 7, 51, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 51, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45c7198a-be6c-4646-8def-e3201fefd743/file', 'properties': {}}, 'image_service': }' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632ea698-e606-41b4-aaa2-e06e2fccd3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632ea698-e606-41b4-aaa2-e06e2fccd3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c77a7a-3bff-4930-aacc-6138cae6d43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:46 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Volume 283189f8-4d1a-4760-b781-6dd5c3be771a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-283189f8-4d1a-4760-b781-6dd5c3be771a', 'volume_size': 1, 'image_id': '45c7198a-be6c-4646-8def-e3201fefd743', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45c7198a-be6c-4646-8def-e3201fefd743', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e13a26d36045bf5e29a2393492ac3e0d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb043dffd3d64106be6253316b1fa5b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '82c26e73afe8f632cae58ae86504b5107220eca8eadc55200c64e2240bfab1cc20323ca98c7eeda810c96d80c08ae3cc529bcb32c99496cbe708d81a2d1974d9', 'id': '45c7198a-be6c-4646-8def-e3201fefd743', 'created_at': datetime.datetime(2026, 7, 24, 7, 51, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 51, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45c7198a-be6c-4646-8def-e3201fefd743/file', 'properties': {}}, 'image_service': } Jul 24 09:51:46 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Trying to clone 283189f8-4d1a-4760-b781-6dd5c3be771a from image 45c7198a-be6c-4646-8def-e3201fefd743 at location (None, [{'url': 'file:///opt/stack/data/glance/images/45c7198a-be6c-4646-8def-e3201fefd743', 'metadata': {}}]). {{(pid=88488) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 09:51:46 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 09:51:46 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Image download 0.00 MB at 0.00 MB/s Jul 24 09:51:46 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[557da37e-362d-47f8-a24b-a9437dc70b62]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:51:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:46 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD Jul 24 09:51:46 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:46 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:46 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD Jul 24 09:51:46 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:47 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD" returned: 1 in 0.331s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:51:47 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Temporary image 45c7198a-be6c-4646-8def-e3201fefd743 is fetched for user 160d51df938f49f29ee9a2b6270966a7. {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 09:51:47 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e12352-6d7f-4638-8388-aeddcac27f6c]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:51:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:47 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD Jul 24 09:51:47 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:47 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:47 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD Jul 24 09:51:47 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:47 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD" returned: 1 in 0.339s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:51:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:51:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:51:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283189f8-4d1a-4760-b781-6dd5c3be771a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb043dffd3d64106be6253316b1fa5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:51:46Z,use_quota=True,user_id='160d51df938f49f29ee9a2b6270966a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:51:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Creating volume 283189f8-4d1a-4760-b781-6dd5c3be771a {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:51:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:51:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:51:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:51:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:51:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:51:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:51:47 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:51:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-283189f8-4d1a-4760-b781-6dd5c3be771a 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:47 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-283189f8-4d1a-4760-b781-6dd5c3be771a 1073741824 Jul 24 09:51:47 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-914d8605-2312-4fd8-8946-8bc3d125ba5d req-21437b13-1ad7-44ec-b832-b68d660d818b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:51:48 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-283189f8-4d1a-4760-b781-6dd5c3be771a 1073741824" returned: 0 in 0.406s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-283189f8-4d1a-4760-b781-6dd5c3be771a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:48 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-283189f8-4d1a-4760-b781-6dd5c3be771a Jul 24 09:51:48 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:48 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-283189f8-4d1a-4760-b781-6dd5c3be771a" returned: 0 in 0.239s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:48 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:51:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:51:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-914d8605-2312-4fd8-8946-8bc3d125ba5d req-21437b13-1ad7-44ec-b832-b68d660d818b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.485s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:51:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [req-914d8605-2312-4fd8-8946-8bc3d125ba5d req-21437b13-1ad7-44ec-b832-b68d660d818b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:51:48 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Attempting download of 45c7198a-be6c-4646-8def-e3201fefd743 ((None, [{'url': 'file:///opt/stack/data/glance/images/45c7198a-be6c-4646-8def-e3201fefd743', 'metadata': {}}])) to volume 283189f8-4d1a-4760-b781-6dd5c3be771a. {{(pid=88488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 09:51:48 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-914d8605-2312-4fd8-8946-8bc3d125ba5d req-21437b13-1ad7-44ec-b832-b68d660d818b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b', 'name': 'volume-574072a5-0cc9-4989-b565-0a2caf3316ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db810316-a057-43e0-816c-1dd3c5f11f7d', 'enforce_multipath': True} {{(pid=88488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 09:51:48 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf47989-081c-4624-b3b3-b331e429ddb7]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:51:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45c7198a-be6c-4646-8def-e3201fefd743_1n6dtz_g {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:48 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-914d8605-2312-4fd8-8946-8bc3d125ba5d req-21437b13-1ad7-44ec-b832-b68d660d818b tempest-TestServerVolumeAttachmentScenario-2066771404 None] attachment_update completed successfully. Jul 24 09:51:48 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45c7198a-be6c-4646-8def-e3201fefd743_1n6dtz_g Jul 24 09:51:48 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:49 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45c7198a-be6c-4646-8def-e3201fefd743_1n6dtz_g" returned: 0 in 0.326s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45c7198a-be6c-4646-8def-e3201fefd743_1n6dtz_g {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:49 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45c7198a-be6c-4646-8def-e3201fefd743_1n6dtz_g Jul 24 09:51:49 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:49 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45c7198a-be6c-4646-8def-e3201fefd743_1n6dtz_g" returned: 1 in 0.354s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45c7198a-be6c-4646-8def-e3201fefd743_1n6dtz_g' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:51:49 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d404af1-95ec-4186-9ae4-bb7a6ea41683]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:51:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:49 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD Jul 24 09:51:49 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:49 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:49 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD Jul 24 09:51:49 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:50 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD" returned: 1 in 0.316s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:51:50 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] 45c7198a-be6c-4646-8def-e3201fefd743 was raw, converting to qcow2 {{(pid=88488) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 09:51:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-283189f8-4d1a-4760-b781-6dd5c3be771a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:50 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-283189f8-4d1a-4760-b781-6dd5c3be771a Jul 24 09:51:50 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:50 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-283189f8-4d1a-4760-b781-6dd5c3be771a" returned: 0 in 0.519s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:50 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_45c7198a-be6c-4646-8def-e3201fefd743_jqy55wgpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-283189f8-4d1a-4760-b781-6dd5c3be771a {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:51:50 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Converted 0.00 MB image at 0.00 MB/s Jul 24 09:51:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-283189f8-4d1a-4760-b781-6dd5c3be771a 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:50 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-283189f8-4d1a-4760-b781-6dd5c3be771a 1G Jul 24 09:51:50 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:50 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-283189f8-4d1a-4760-b781-6dd5c3be771a 1G" returned: 0 in 0.312s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:50 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Downloaded image 45c7198a-be6c-4646-8def-e3201fefd743 ((None, [{'url': 'file:///opt/stack/data/glance/images/45c7198a-be6c-4646-8def-e3201fefd743', 'metadata': {}}])) to volume 283189f8-4d1a-4760-b781-6dd5c3be771a successfully. {{(pid=88488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 09:51:50 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Temporary image 45c7198a-be6c-4646-8def-e3201fefd743 for user 160d51df938f49f29ee9a2b6270966a7 is deleted. {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 09:51:50 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Marking volume 283189f8-4d1a-4760-b781-6dd5c3be771a as bootable. {{(pid=88488) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 09:51:50 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Copying metadata from image 45c7198a-be6c-4646-8def-e3201fefd743 to 283189f8-4d1a-4760-b781-6dd5c3be771a. {{(pid=88488) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 09:51:50 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Creating volume glance metadata for volume 283189f8-4d1a-4760-b781-6dd5c3be771a backed by image 45c7198a-be6c-4646-8def-e3201fefd743 with: {'image_id': '45c7198a-be6c-4646-8def-e3201fefd743', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e13a26d36045bf5e29a2393492ac3e0d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88488) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 09:51:50 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-639ce39b-dad5-4d75-9b53-a65049397c7c req-a9903157-9fd8-42fd-93da-1d7b7a62ba71 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Terminate volume connection completed successfully. Jul 24 09:51:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-639ce39b-dad5-4d75-9b53-a65049397c7c req-a9903157-9fd8-42fd-93da-1d7b7a62ba71 tempest-TestServerVolumeAttachmentScenario-2066771404 None] Deleting attachment db810316-a057-43e0-816c-1dd3c5f11f7d. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:51:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c77a7a-3bff-4930-aacc-6138cae6d43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-283189f8-4d1a-4760-b781-6dd5c3be771a', 'volume_size': 1, 'image_id': '45c7198a-be6c-4646-8def-e3201fefd743', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45c7198a-be6c-4646-8def-e3201fefd743', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e13a26d36045bf5e29a2393492ac3e0d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb043dffd3d64106be6253316b1fa5b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '82c26e73afe8f632cae58ae86504b5107220eca8eadc55200c64e2240bfab1cc20323ca98c7eeda810c96d80c08ae3cc529bcb32c99496cbe708d81a2d1974d9', 'id': '45c7198a-be6c-4646-8def-e3201fefd743', 'created_at': datetime.datetime(2026, 7, 24, 7, 51, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 51, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45c7198a-be6c-4646-8def-e3201fefd743/file', 'properties': {}}, 'image_service': }' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74111980-5495-428e-b4ff-8fc0744be6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:51 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Volume volume-283189f8-4d1a-4760-b781-6dd5c3be771a (283189f8-4d1a-4760-b781-6dd5c3be771a): created successfully Jul 24 09:51:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74111980-5495-428e-b4ff-8fc0744be6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Flow 'volume_create_manager' (8be4418f-d431-4ee5-8240-2f3ba25a05a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:51:51 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-cdb8e706-d0bd-493b-ac48-75f366d06405 tempest-VolumeImageDependencyTests-1613008324 None] Created volume successfully. Jul 24 09:51:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2d591109-8111-48d1-8973-2f695079edd6 tempest-VolumeImageDependencyTests-1613008324 None] Acquiring lock "cinder-283189f8-4d1a-4760-b781-6dd5c3be771a-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:51:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2d591109-8111-48d1-8973-2f695079edd6 tempest-VolumeImageDependencyTests-1613008324 None] Lock "cinder-283189f8-4d1a-4760-b781-6dd5c3be771a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:51:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2d591109-8111-48d1-8973-2f695079edd6 tempest-VolumeImageDependencyTests-1613008324 None] Acquiring lock "cinder-quobyte-283189f8-4d1a-4760-b781-6dd5c3be771a" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:51:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2d591109-8111-48d1-8973-2f695079edd6 tempest-VolumeImageDependencyTests-1613008324 None] Lock "cinder-quobyte-283189f8-4d1a-4760-b781-6dd5c3be771a" acquired by "delete_volume" :: waited 0.015s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:51:51 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37ff06d-bce9-4e2a-a329-72f781c30634]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:51:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2d591109-8111-48d1-8973-2f695079edd6 tempest-VolumeImageDependencyTests-1613008324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-283189f8-4d1a-4760-b781-6dd5c3be771a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:51 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-283189f8-4d1a-4760-b781-6dd5c3be771a Jul 24 09:51:51 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:51 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2d591109-8111-48d1-8973-2f695079edd6 tempest-VolumeImageDependencyTests-1613008324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-283189f8-4d1a-4760-b781-6dd5c3be771a" returned: 0 in 0.370s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2d591109-8111-48d1-8973-2f695079edd6 tempest-VolumeImageDependencyTests-1613008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-283189f8-4d1a-4760-b781-6dd5c3be771a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:51 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-283189f8-4d1a-4760-b781-6dd5c3be771a Jul 24 09:51:51 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:52 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2d591109-8111-48d1-8973-2f695079edd6 tempest-VolumeImageDependencyTests-1613008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-283189f8-4d1a-4760-b781-6dd5c3be771a" returned: 0 in 0.264s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2d591109-8111-48d1-8973-2f695079edd6 tempest-VolumeImageDependencyTests-1613008324 None] Lock "cinder-quobyte-283189f8-4d1a-4760-b781-6dd5c3be771a" released by "delete_volume" :: held 0.675s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:51:52 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-2d591109-8111-48d1-8973-2f695079edd6 tempest-VolumeImageDependencyTests-1613008324 None] Created reservations ['b646ba84-966f-4635-96e2-9daadaac8220', 'c3fb7260-ad61-4706-99b8-72753e95796c', '5f278f89-2deb-4e6d-b531-1a2293f1b83a', '5a3ed9df-43c7-4a27-aed3-bfd015ec6146'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:51:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2d591109-8111-48d1-8973-2f695079edd6 tempest-VolumeImageDependencyTests-1613008324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:51:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2d591109-8111-48d1-8973-2f695079edd6 tempest-VolumeImageDependencyTests-1613008324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:51:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2d591109-8111-48d1-8973-2f695079edd6 tempest-VolumeImageDependencyTests-1613008324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:51:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2d591109-8111-48d1-8973-2f695079edd6 tempest-VolumeImageDependencyTests-1613008324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:51:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2d591109-8111-48d1-8973-2f695079edd6 tempest-VolumeImageDependencyTests-1613008324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:51:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2d591109-8111-48d1-8973-2f695079edd6 tempest-VolumeImageDependencyTests-1613008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:52 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:51:52 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:52 devstack cinder-volume[88488]: INFO cinder.volume.manager [req-72a40a1f-b3e1-46e2-9a96-36fd3132344a req-09b32a16-7c83-4fe3-9868-e4eb050c912a tempest-TestServerVolumeAttachmentScenario-2066771404 None] Terminate volume connection completed successfully. Jul 24 09:51:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [req-72a40a1f-b3e1-46e2-9a96-36fd3132344a req-09b32a16-7c83-4fe3-9868-e4eb050c912a tempest-TestServerVolumeAttachmentScenario-2066771404 None] Deleting attachment deb44249-ceb2-4baa-aa24-31297e19f289. {{(pid=88488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 09:51:52 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2d591109-8111-48d1-8973-2f695079edd6 tempest-VolumeImageDependencyTests-1613008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.279s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:52 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-2d591109-8111-48d1-8973-2f695079edd6 tempest-VolumeImageDependencyTests-1613008324 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:51:52 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-2d591109-8111-48d1-8973-2f695079edd6 tempest-VolumeImageDependencyTests-1613008324 None] Deleted volume successfully. Jul 24 09:51:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2d591109-8111-48d1-8973-2f695079edd6 tempest-VolumeImageDependencyTests-1613008324 None] Lock "cinder-283189f8-4d1a-4760-b781-6dd5c3be771a-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Flow 'volume_create_manager' (5459cc7f-0632-4e7a-94ee-c10829dda7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644690f0-76c6-41a8-a6dc-0905fe4a3acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644690f0-76c6-41a8-a6dc-0905fe4a3acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813348391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3479f1-1794-4588-88d0-37780725b98c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8fa547b56b4b54a4b964c021910872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:51:57Z,use_quota=True,user_id='0e341db06b1e43809764cfece6104b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8403d3d-6e26-4792-ad67-c9345a63db33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8403d3d-6e26-4792-ad67-c9345a63db33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0195e02-14ec-4c1a-a2ee-ae646ee8627a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0195e02-14ec-4c1a-a2ee-ae646ee8627a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba3479f1-1794-4588-88d0-37780725b98c', 'volume_name': 'volume-ba3479f1-1794-4588-88d0-37780725b98c', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a3a1080-b8eb-4ade-8624-58a17a5dbea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a3a1080-b8eb-4ade-8624-58a17a5dbea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c639c39-2ddd-4d76-90ce-980d2cfa169b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:56 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Volume ba3479f1-1794-4588-88d0-37780725b98c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba3479f1-1794-4588-88d0-37780725b98c', 'volume_size': 1} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813348391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3479f1-1794-4588-88d0-37780725b98c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8fa547b56b4b54a4b964c021910872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:51:57Z,use_quota=True,user_id='0e341db06b1e43809764cfece6104b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Creating volume ba3479f1-1794-4588-88d0-37780725b98c {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:51:56 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba3479f1-1794-4588-88d0-37780725b98c 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:56 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba3479f1-1794-4588-88d0-37780725b98c 1073741824 Jul 24 09:51:56 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eb6e5f23-3545-4225-b384-8e408d264f6b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Acquiring lock "cinder-574072a5-0cc9-4989-b565-0a2caf3316ea-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eb6e5f23-3545-4225-b384-8e408d264f6b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "cinder-574072a5-0cc9-4989-b565-0a2caf3316ea-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eb6e5f23-3545-4225-b384-8e408d264f6b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Acquiring lock "cinder-quobyte-574072a5-0cc9-4989-b565-0a2caf3316ea" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eb6e5f23-3545-4225-b384-8e408d264f6b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "cinder-quobyte-574072a5-0cc9-4989-b565-0a2caf3316ea" acquired by "delete_volume" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[09950625-05eb-4acb-9577-748a5752456a]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:51:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eb6e5f23-3545-4225-b384-8e408d264f6b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-574072a5-0cc9-4989-b565-0a2caf3316ea {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:57 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-574072a5-0cc9-4989-b565-0a2caf3316ea Jul 24 09:51:57 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:57 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba3479f1-1794-4588-88d0-37780725b98c 1073741824" returned: 0 in 0.438s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba3479f1-1794-4588-88d0-37780725b98c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:57 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba3479f1-1794-4588-88d0-37780725b98c Jul 24 09:51:57 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:57 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eb6e5f23-3545-4225-b384-8e408d264f6b tempest-TestServerVolumeAttachmentScenario-2066771404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-574072a5-0cc9-4989-b565-0a2caf3316ea" returned: 0 in 0.381s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eb6e5f23-3545-4225-b384-8e408d264f6b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-574072a5-0cc9-4989-b565-0a2caf3316ea {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:57 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-574072a5-0cc9-4989-b565-0a2caf3316ea Jul 24 09:51:57 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:57 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba3479f1-1794-4588-88d0-37780725b98c" returned: 0 in 0.258s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c639c39-2ddd-4d76-90ce-980d2cfa169b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba3479f1-1794-4588-88d0-37780725b98c', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484ee3e3-495d-47a6-813f-498cccc91f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:57 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Volume volume-ba3479f1-1794-4588-88d0-37780725b98c (ba3479f1-1794-4588-88d0-37780725b98c): created successfully Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484ee3e3-495d-47a6-813f-498cccc91f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Flow 'volume_create_manager' (5459cc7f-0632-4e7a-94ee-c10829dda7d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:51:57 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-ee933512-8abb-4d80-9d8f-c2deb6b915f4 tempest-ProjectReaderTests-1656679768 None] Created volume successfully. Jul 24 09:51:57 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eb6e5f23-3545-4225-b384-8e408d264f6b tempest-TestServerVolumeAttachmentScenario-2066771404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-574072a5-0cc9-4989-b565-0a2caf3316ea" returned: 0 in 0.284s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eb6e5f23-3545-4225-b384-8e408d264f6b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "cinder-quobyte-574072a5-0cc9-4989-b565-0a2caf3316ea" released by "delete_volume" :: held 0.704s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-eb6e5f23-3545-4225-b384-8e408d264f6b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Created reservations ['d7af17f4-00ab-4bc5-8924-b8efa37f8007', '6da8e9f9-f762-434a-883e-1ab552667df9', '752a1172-d5b8-4c4a-bc59-c5b47e78f860', 'e293ece5-9c6c-4294-b5f2-80d1c41b420b'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-eb6e5f23-3545-4225-b384-8e408d264f6b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-eb6e5f23-3545-4225-b384-8e408d264f6b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-eb6e5f23-3545-4225-b384-8e408d264f6b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-eb6e5f23-3545-4225-b384-8e408d264f6b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-eb6e5f23-3545-4225-b384-8e408d264f6b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eb6e5f23-3545-4225-b384-8e408d264f6b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:57 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:51:57 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-509df2b5-529f-4ed2-8674-2105d44a906d tempest-ProjectReaderTests-1656679768 None] Acquiring lock "cinder-ba3479f1-1794-4588-88d0-37780725b98c-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-509df2b5-529f-4ed2-8674-2105d44a906d tempest-ProjectReaderTests-1656679768 None] Lock "cinder-ba3479f1-1794-4588-88d0-37780725b98c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-509df2b5-529f-4ed2-8674-2105d44a906d tempest-ProjectReaderTests-1656679768 None] Acquiring lock "cinder-quobyte-ba3479f1-1794-4588-88d0-37780725b98c" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-509df2b5-529f-4ed2-8674-2105d44a906d tempest-ProjectReaderTests-1656679768 None] Lock "cinder-quobyte-ba3479f1-1794-4588-88d0-37780725b98c" acquired by "delete_volume" :: waited 0.014s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[487dbde4-3920-4849-8ae6-1bac7258b094]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-509df2b5-529f-4ed2-8674-2105d44a906d tempest-ProjectReaderTests-1656679768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba3479f1-1794-4588-88d0-37780725b98c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:57 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba3479f1-1794-4588-88d0-37780725b98c Jul 24 09:51:57 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:57 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eb6e5f23-3545-4225-b384-8e408d264f6b tempest-TestServerVolumeAttachmentScenario-2066771404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.239s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:57 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-eb6e5f23-3545-4225-b384-8e408d264f6b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:51:57 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-eb6e5f23-3545-4225-b384-8e408d264f6b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Deleted volume successfully. Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eb6e5f23-3545-4225-b384-8e408d264f6b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "cinder-574072a5-0cc9-4989-b565-0a2caf3316ea-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-280f3948-1a1c-4acc-8913-6354eb095d2b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Acquiring lock "cinder-300cff55-dd39-40cd-8045-de4a09599627-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-280f3948-1a1c-4acc-8913-6354eb095d2b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "cinder-300cff55-dd39-40cd-8045-de4a09599627-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-280f3948-1a1c-4acc-8913-6354eb095d2b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Acquiring lock "cinder-quobyte-300cff55-dd39-40cd-8045-de4a09599627" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-280f3948-1a1c-4acc-8913-6354eb095d2b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "cinder-quobyte-300cff55-dd39-40cd-8045-de4a09599627" acquired by "delete_volume" :: waited 0.015s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b76b27-c8c5-47eb-86aa-6b522ae09bee]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-280f3948-1a1c-4acc-8913-6354eb095d2b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-300cff55-dd39-40cd-8045-de4a09599627 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:58 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-300cff55-dd39-40cd-8045-de4a09599627 Jul 24 09:51:58 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:58 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-509df2b5-529f-4ed2-8674-2105d44a906d tempest-ProjectReaderTests-1656679768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba3479f1-1794-4588-88d0-37780725b98c" returned: 0 in 0.366s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-509df2b5-529f-4ed2-8674-2105d44a906d tempest-ProjectReaderTests-1656679768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba3479f1-1794-4588-88d0-37780725b98c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:58 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba3479f1-1794-4588-88d0-37780725b98c Jul 24 09:51:58 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:58 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-280f3948-1a1c-4acc-8913-6354eb095d2b tempest-TestServerVolumeAttachmentScenario-2066771404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-300cff55-dd39-40cd-8045-de4a09599627" returned: 0 in 0.346s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-280f3948-1a1c-4acc-8913-6354eb095d2b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-300cff55-dd39-40cd-8045-de4a09599627 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:58 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-509df2b5-529f-4ed2-8674-2105d44a906d tempest-ProjectReaderTests-1656679768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ba3479f1-1794-4588-88d0-37780725b98c" returned: 0 in 0.249s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:58 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-300cff55-dd39-40cd-8045-de4a09599627 Jul 24 09:51:58 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-509df2b5-529f-4ed2-8674-2105d44a906d tempest-ProjectReaderTests-1656679768 None] Lock "cinder-quobyte-ba3479f1-1794-4588-88d0-37780725b98c" released by "delete_volume" :: held 0.652s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-509df2b5-529f-4ed2-8674-2105d44a906d tempest-ProjectReaderTests-1656679768 None] Created reservations ['2110c5bd-58e3-449e-8a2f-5ef509a0e7e8', '4cde6ce4-0893-44be-ad80-7c70e7e90c84', '62faed0c-7f24-4e69-bb7b-7d6b742508c0', '45d83f53-7a0d-496f-8391-2fa76f75c7a0'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-509df2b5-529f-4ed2-8674-2105d44a906d tempest-ProjectReaderTests-1656679768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-509df2b5-529f-4ed2-8674-2105d44a906d tempest-ProjectReaderTests-1656679768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-509df2b5-529f-4ed2-8674-2105d44a906d tempest-ProjectReaderTests-1656679768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-509df2b5-529f-4ed2-8674-2105d44a906d tempest-ProjectReaderTests-1656679768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-509df2b5-529f-4ed2-8674-2105d44a906d tempest-ProjectReaderTests-1656679768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-509df2b5-529f-4ed2-8674-2105d44a906d tempest-ProjectReaderTests-1656679768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:58 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:51:58 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:58 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-280f3948-1a1c-4acc-8913-6354eb095d2b tempest-TestServerVolumeAttachmentScenario-2066771404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-300cff55-dd39-40cd-8045-de4a09599627" returned: 0 in 0.246s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-280f3948-1a1c-4acc-8913-6354eb095d2b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "cinder-quobyte-300cff55-dd39-40cd-8045-de4a09599627" released by "delete_volume" :: held 0.628s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-280f3948-1a1c-4acc-8913-6354eb095d2b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Created reservations ['f029be7b-eeb0-4965-ab99-b89d11a05329', '7e7b2f7b-a265-4d16-a624-36b39e2558ca', 'e34b3144-429a-46d3-ac91-70c9691b06fe', '1c1843ab-c3cd-475e-aecd-dfe2af1ebed5'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-280f3948-1a1c-4acc-8913-6354eb095d2b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-280f3948-1a1c-4acc-8913-6354eb095d2b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-280f3948-1a1c-4acc-8913-6354eb095d2b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-280f3948-1a1c-4acc-8913-6354eb095d2b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-280f3948-1a1c-4acc-8913-6354eb095d2b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-280f3948-1a1c-4acc-8913-6354eb095d2b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:58 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-509df2b5-529f-4ed2-8674-2105d44a906d tempest-ProjectReaderTests-1656679768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.246s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-509df2b5-529f-4ed2-8674-2105d44a906d tempest-ProjectReaderTests-1656679768 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:51:58 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-509df2b5-529f-4ed2-8674-2105d44a906d tempest-ProjectReaderTests-1656679768 None] Deleted volume successfully. Jul 24 09:51:58 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:51:58 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-509df2b5-529f-4ed2-8674-2105d44a906d tempest-ProjectReaderTests-1656679768 None] Lock "cinder-ba3479f1-1794-4588-88d0-37780725b98c-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:51:59 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-280f3948-1a1c-4acc-8913-6354eb095d2b tempest-TestServerVolumeAttachmentScenario-2066771404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.237s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-280f3948-1a1c-4acc-8913-6354eb095d2b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:51:59 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-280f3948-1a1c-4acc-8913-6354eb095d2b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Deleted volume successfully. Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-280f3948-1a1c-4acc-8913-6354eb095d2b tempest-TestServerVolumeAttachmentScenario-2066771404 None] Lock "cinder-300cff55-dd39-40cd-8045-de4a09599627-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Flow 'volume_create_manager' (03594789-44e6-4c6d-b059-24f5bf1ecb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cd4594-a11d-4fff-a337-f3b45e267aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cd4594-a11d-4fff-a337-f3b45e267aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1271409084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a72c774f-bc15-4465-a6a9-5e1cd95acf97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8fa547b56b4b54a4b964c021910872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:51:59Z,use_quota=True,user_id='0e341db06b1e43809764cfece6104b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (739d0f50-8ce2-440c-8e89-7fccd7548d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (739d0f50-8ce2-440c-8e89-7fccd7548d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d549c0c9-9c08-4b0d-a441-80affe07bb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d549c0c9-9c08-4b0d-a441-80affe07bb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a72c774f-bc15-4465-a6a9-5e1cd95acf97', 'volume_name': 'volume-a72c774f-bc15-4465-a6a9-5e1cd95acf97', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab7aa1c-c5cd-4c80-8b11-f69c4f40438a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab7aa1c-c5cd-4c80-8b11-f69c4f40438a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9221cb61-f4e7-4f3f-88ca-21f0d42929cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:51:59 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Volume a72c774f-bc15-4465-a6a9-5e1cd95acf97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a72c774f-bc15-4465-a6a9-5e1cd95acf97', 'volume_size': 1} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1271409084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a72c774f-bc15-4465-a6a9-5e1cd95acf97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8fa547b56b4b54a4b964c021910872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:51:59Z,use_quota=True,user_id='0e341db06b1e43809764cfece6104b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Creating volume a72c774f-bc15-4465-a6a9-5e1cd95acf97 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:51:59 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a72c774f-bc15-4465-a6a9-5e1cd95acf97 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:51:59 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a72c774f-bc15-4465-a6a9-5e1cd95acf97 1073741824 Jul 24 09:51:59 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:51:59 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a72c774f-bc15-4465-a6a9-5e1cd95acf97 1073741824" returned: 0 in 0.459s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:51:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a72c774f-bc15-4465-a6a9-5e1cd95acf97 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:52:00 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a72c774f-bc15-4465-a6a9-5e1cd95acf97 Jul 24 09:52:00 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:52:00 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 24 09:52:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a72c774f-bc15-4465-a6a9-5e1cd95acf97" returned: 0 in 0.255s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:52:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:52:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:52:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9221cb61-f4e7-4f3f-88ca-21f0d42929cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a72c774f-bc15-4465-a6a9-5e1cd95acf97', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:52:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b772cf90-3875-432a-81ff-ce9c351e366a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:52:00 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Volume volume-a72c774f-bc15-4465-a6a9-5e1cd95acf97 (a72c774f-bc15-4465-a6a9-5e1cd95acf97): created successfully Jul 24 09:52:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b772cf90-3875-432a-81ff-ce9c351e366a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:52:00 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Flow 'volume_create_manager' (03594789-44e6-4c6d-b059-24f5bf1ecb8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:52:00 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-acf16c0e-7b80-449f-be57-13a4d6095c82 tempest-ProjectReaderTests-1656679768 None] Created volume successfully. Jul 24 09:52:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-300e2bd0-e0ba-4b89-9279-c6bb82e9a5de tempest-ProjectReaderTests-1656679768 None] Acquiring lock "cinder-a72c774f-bc15-4465-a6a9-5e1cd95acf97-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:52:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-300e2bd0-e0ba-4b89-9279-c6bb82e9a5de tempest-ProjectReaderTests-1656679768 None] Lock "cinder-a72c774f-bc15-4465-a6a9-5e1cd95acf97-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:52:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-300e2bd0-e0ba-4b89-9279-c6bb82e9a5de tempest-ProjectReaderTests-1656679768 None] Acquiring lock "cinder-quobyte-a72c774f-bc15-4465-a6a9-5e1cd95acf97" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:52:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-300e2bd0-e0ba-4b89-9279-c6bb82e9a5de tempest-ProjectReaderTests-1656679768 None] Lock "cinder-quobyte-a72c774f-bc15-4465-a6a9-5e1cd95acf97" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:52:00 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2d83a4-b4fd-4bca-b733-0395567f291e]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:52:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-300e2bd0-e0ba-4b89-9279-c6bb82e9a5de tempest-ProjectReaderTests-1656679768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a72c774f-bc15-4465-a6a9-5e1cd95acf97 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:52:00 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a72c774f-bc15-4465-a6a9-5e1cd95acf97 Jul 24 09:52:00 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:52:00 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 24 09:52:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-300e2bd0-e0ba-4b89-9279-c6bb82e9a5de tempest-ProjectReaderTests-1656679768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a72c774f-bc15-4465-a6a9-5e1cd95acf97" returned: 0 in 0.368s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:52:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-300e2bd0-e0ba-4b89-9279-c6bb82e9a5de tempest-ProjectReaderTests-1656679768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a72c774f-bc15-4465-a6a9-5e1cd95acf97 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:52:00 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a72c774f-bc15-4465-a6a9-5e1cd95acf97 Jul 24 09:52:00 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:52:01 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 24 09:52:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-300e2bd0-e0ba-4b89-9279-c6bb82e9a5de tempest-ProjectReaderTests-1656679768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a72c774f-bc15-4465-a6a9-5e1cd95acf97" returned: 0 in 0.260s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:52:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-300e2bd0-e0ba-4b89-9279-c6bb82e9a5de tempest-ProjectReaderTests-1656679768 None] Lock "cinder-quobyte-a72c774f-bc15-4465-a6a9-5e1cd95acf97" released by "delete_volume" :: held 0.670s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:52:01 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-300e2bd0-e0ba-4b89-9279-c6bb82e9a5de tempest-ProjectReaderTests-1656679768 None] Created reservations ['fdb995df-cd39-4a09-a63d-07f23cb7b559', 'cec5a72e-5d27-4b9d-80a3-bb4eb8a5c492', 'faf743a1-da6b-4a00-8c09-4dfab5fb81c0', 'e2b48dc4-e889-4e99-9583-d8ab73bc30d8'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:52:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-300e2bd0-e0ba-4b89-9279-c6bb82e9a5de tempest-ProjectReaderTests-1656679768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:52:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-300e2bd0-e0ba-4b89-9279-c6bb82e9a5de tempest-ProjectReaderTests-1656679768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:52:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-300e2bd0-e0ba-4b89-9279-c6bb82e9a5de tempest-ProjectReaderTests-1656679768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:52:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-300e2bd0-e0ba-4b89-9279-c6bb82e9a5de tempest-ProjectReaderTests-1656679768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:52:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-300e2bd0-e0ba-4b89-9279-c6bb82e9a5de tempest-ProjectReaderTests-1656679768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:52:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-300e2bd0-e0ba-4b89-9279-c6bb82e9a5de tempest-ProjectReaderTests-1656679768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:52:01 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:52:01 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:52:01 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Jul 24 09:52:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-300e2bd0-e0ba-4b89-9279-c6bb82e9a5de tempest-ProjectReaderTests-1656679768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.279s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:52:01 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-300e2bd0-e0ba-4b89-9279-c6bb82e9a5de tempest-ProjectReaderTests-1656679768 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:52:01 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-300e2bd0-e0ba-4b89-9279-c6bb82e9a5de tempest-ProjectReaderTests-1656679768 None] Deleted volume successfully. Jul 24 09:52:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-300e2bd0-e0ba-4b89-9279-c6bb82e9a5de tempest-ProjectReaderTests-1656679768 None] Lock "cinder-a72c774f-bc15-4465-a6a9-5e1cd95acf97-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:52:11 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=55,cinder:UPDATE=48,cinder:INSERT=15,cinder:DELETE=4 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:52:11 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=78,cinder:UPDATE=89,cinder:DELETE=8,cinder:INSERT=23 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:52:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:52:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:52:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:52:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:52:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:52:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:52:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:52:15 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:52:15 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:52:15 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 24 09:52:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.281s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:52:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:52:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:52:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 28 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:52:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Flow 'volume_create_manager' (42094ebf-88ef-438b-a03c-2026e1e5d414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2662f6a8-b68b-47b7-a656-f7ec42a0b10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2662f6a8-b68b-47b7-a656-f7ec42a0b10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-714871518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e16b523f-84de-43c4-ad66-7fb38eb88f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e569a5229dfd45ee962ae6c3177dd55a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:52:26Z,use_quota=True,user_id='9ec6aaacb3e04407b16312f0fe33f16f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc5cc71-ca81-49ac-89d1-6f3191caf4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc5cc71-ca81-49ac-89d1-6f3191caf4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add60cf7-8eab-4536-a4c6-99c1d7387f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add60cf7-8eab-4536-a4c6-99c1d7387f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e16b523f-84de-43c4-ad66-7fb38eb88f23', 'volume_name': 'volume-e16b523f-84de-43c4-ad66-7fb38eb88f23', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e9b1fc-8859-488a-a6f7-f32d1f1fdc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e9b1fc-8859-488a-a6f7-f32d1f1fdc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b298153-658f-4215-9b6f-8f626a140603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:52:25 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Volume e16b523f-84de-43c4-ad66-7fb38eb88f23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e16b523f-84de-43c4-ad66-7fb38eb88f23', 'volume_size': 1} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-714871518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e16b523f-84de-43c4-ad66-7fb38eb88f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e569a5229dfd45ee962ae6c3177dd55a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:52:26Z,use_quota=True,user_id='9ec6aaacb3e04407b16312f0fe33f16f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Creating volume e16b523f-84de-43c4-ad66-7fb38eb88f23 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:52:25 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:52:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:52:25 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23 1073741824 Jul 24 09:52:25 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:52:26 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 24 09:52:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23 1073741824" returned: 0 in 0.389s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:52:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:52:26 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23 Jul 24 09:52:26 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:52:26 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jul 24 09:52:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23" returned: 0 in 0.242s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:52:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:52:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:52:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b298153-658f-4215-9b6f-8f626a140603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e16b523f-84de-43c4-ad66-7fb38eb88f23', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:52:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d328552-e9bf-4435-b2d2-5527cb339254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:52:26 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Volume volume-e16b523f-84de-43c4-ad66-7fb38eb88f23 (e16b523f-84de-43c4-ad66-7fb38eb88f23): created successfully Jul 24 09:52:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d328552-e9bf-4435-b2d2-5527cb339254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:52:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Flow 'volume_create_manager' (42094ebf-88ef-438b-a03c-2026e1e5d414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:52:26 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-edfb8dc5-d6f4-4c1e-bc5b-421eddf30dd9 tempest-TestImageHashVerification-1473910708 None] Created volume successfully. Jul 24 09:52:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c5b7611e-3c7a-4630-8f37-bc4a5a712f5a tempest-TestImageHashVerification-1473910708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:52:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c5b7611e-3c7a-4630-8f37-bc4a5a712f5a tempest-TestImageHashVerification-1473910708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:52:27 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2dd7d5-aa7d-432a-928f-f1a3b535cfd2]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:52:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c5b7611e-3c7a-4630-8f37-bc4a5a712f5a tempest-TestImageHashVerification-1473910708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:52:27 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23 Jul 24 09:52:27 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:52:27 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 24 09:52:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c5b7611e-3c7a-4630-8f37-bc4a5a712f5a tempest-TestImageHashVerification-1473910708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23" returned: 0 in 0.343s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:52:27 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0aba12-eae8-4072-9b36-4aab2d11ddb9]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:52:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c5b7611e-3c7a-4630-8f37-bc4a5a712f5a tempest-TestImageHashVerification-1473910708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:52:27 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23 Jul 24 09:52:27 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:52:28 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 24 09:52:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c5b7611e-3c7a-4630-8f37-bc4a5a712f5a tempest-TestImageHashVerification-1473910708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23" returned: 0 in 0.339s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:52:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c5b7611e-3c7a-4630-8f37-bc4a5a712f5a tempest-TestImageHashVerification-1473910708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23 /opt/stack/data/cinder/conversion/e16b523f-84de-43c4-ad66-7fb38eb88f23.temp_image.41656af9-32c2-4df6-b8d2-fcd4d6bb6f34vwd2ortw.img {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:52:28 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23 /opt/stack/data/cinder/conversion/e16b523f-84de-43c4-ad66-7fb38eb88f23.temp_image.41656af9-32c2-4df6-b8d2-fcd4d6bb6f34vwd2ortw.img Jul 24 09:52:28 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:52:31 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jul 24 09:52:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c5b7611e-3c7a-4630-8f37-bc4a5a712f5a tempest-TestImageHashVerification-1473910708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23 /opt/stack/data/cinder/conversion/e16b523f-84de-43c4-ad66-7fb38eb88f23.temp_image.41656af9-32c2-4df6-b8d2-fcd4d6bb6f34vwd2ortw.img" returned: 0 in 3.823s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:52:31 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e6549d-18ab-4754-9f17-e960624675d3]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:52:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c5b7611e-3c7a-4630-8f37-bc4a5a712f5a tempest-TestImageHashVerification-1473910708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:52:31 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23 Jul 24 09:52:31 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:52:32 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 24 09:52:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c5b7611e-3c7a-4630-8f37-bc4a5a712f5a tempest-TestImageHashVerification-1473910708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23" returned: 0 in 0.522s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:52:32 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-c5b7611e-3c7a-4630-8f37-bc4a5a712f5a tempest-TestImageHashVerification-1473910708 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23, size 1024.00 MB, duration 3.82 sec, destination /opt/stack/data/cinder/conversion/e16b523f-84de-43c4-ad66-7fb38eb88f23.temp_image.41656af9-32c2-4df6-b8d2-fcd4d6bb6f34vwd2ortw.img {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:52:32 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-c5b7611e-3c7a-4630-8f37-bc4a5a712f5a tempest-TestImageHashVerification-1473910708 None] Converted 1024.00 MB image at 267.77 MB/s Jul 24 09:52:32 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-c5b7611e-3c7a-4630-8f37-bc4a5a712f5a tempest-TestImageHashVerification-1473910708 None] 41656af9-32c2-4df6-b8d2-fcd4d6bb6f34 was raw, no need to convert to raw {{(pid=88488) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 24 09:52:42 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:52:42 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=4,cinder:SELECT=5 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:52:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c5b7611e-3c7a-4630-8f37-bc4a5a712f5a tempest-TestImageHashVerification-1473910708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.235s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:52:50 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c5b7611e-3c7a-4630-8f37-bc4a5a712f5a tempest-TestImageHashVerification-1473910708 None] Uploaded volume to glance image-id: 41656af9-32c2-4df6-b8d2-fcd4d6bb6f34. {{(pid=88488) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 24 09:52:50 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c5b7611e-3c7a-4630-8f37-bc4a5a712f5a tempest-TestImageHashVerification-1473910708 None] Copy volume to image completed successfully. Jul 24 09:52:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-08bd0077-d296-4648-a760-82677388e6e4 tempest-TestImageHashVerification-1473910708 None] Acquiring lock "cinder-e16b523f-84de-43c4-ad66-7fb38eb88f23-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:52:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-08bd0077-d296-4648-a760-82677388e6e4 tempest-TestImageHashVerification-1473910708 None] Lock "cinder-e16b523f-84de-43c4-ad66-7fb38eb88f23-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:52:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-08bd0077-d296-4648-a760-82677388e6e4 tempest-TestImageHashVerification-1473910708 None] Acquiring lock "cinder-quobyte-e16b523f-84de-43c4-ad66-7fb38eb88f23" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:52:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-08bd0077-d296-4648-a760-82677388e6e4 tempest-TestImageHashVerification-1473910708 None] Lock "cinder-quobyte-e16b523f-84de-43c4-ad66-7fb38eb88f23" acquired by "delete_volume" :: waited 0.021s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:52:51 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[89377509-d5c4-42e0-9005-165b2f59c0c8]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:52:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-08bd0077-d296-4648-a760-82677388e6e4 tempest-TestImageHashVerification-1473910708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:52:51 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23 Jul 24 09:52:51 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:52:52 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 24 09:52:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-08bd0077-d296-4648-a760-82677388e6e4 tempest-TestImageHashVerification-1473910708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23" returned: 0 in 0.346s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:52:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-08bd0077-d296-4648-a760-82677388e6e4 tempest-TestImageHashVerification-1473910708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:52:52 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23 Jul 24 09:52:52 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:52:52 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jul 24 09:52:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-08bd0077-d296-4648-a760-82677388e6e4 tempest-TestImageHashVerification-1473910708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e16b523f-84de-43c4-ad66-7fb38eb88f23" returned: 0 in 0.256s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:52:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-08bd0077-d296-4648-a760-82677388e6e4 tempest-TestImageHashVerification-1473910708 None] Lock "cinder-quobyte-e16b523f-84de-43c4-ad66-7fb38eb88f23" released by "delete_volume" :: held 0.641s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:52:52 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-08bd0077-d296-4648-a760-82677388e6e4 tempest-TestImageHashVerification-1473910708 None] Created reservations ['8a4a8cd1-505a-401c-aa7b-03986851ac84', 'b7e6b987-24ef-4a8f-a728-2f0d76a3cabe', '798a5ec3-e0e0-4d01-976f-6b784f2ac783', 'd154cd78-2899-4174-bd06-cd5df8242ea1'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:52:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-08bd0077-d296-4648-a760-82677388e6e4 tempest-TestImageHashVerification-1473910708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:52:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-08bd0077-d296-4648-a760-82677388e6e4 tempest-TestImageHashVerification-1473910708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:52:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-08bd0077-d296-4648-a760-82677388e6e4 tempest-TestImageHashVerification-1473910708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:52:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-08bd0077-d296-4648-a760-82677388e6e4 tempest-TestImageHashVerification-1473910708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:52:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-08bd0077-d296-4648-a760-82677388e6e4 tempest-TestImageHashVerification-1473910708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:52:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-08bd0077-d296-4648-a760-82677388e6e4 tempest-TestImageHashVerification-1473910708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:52:52 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:52:52 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:52:52 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Jul 24 09:52:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-08bd0077-d296-4648-a760-82677388e6e4 tempest-TestImageHashVerification-1473910708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.240s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:52:52 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-08bd0077-d296-4648-a760-82677388e6e4 tempest-TestImageHashVerification-1473910708 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:52:52 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-08bd0077-d296-4648-a760-82677388e6e4 tempest-TestImageHashVerification-1473910708 None] Deleted volume successfully. Jul 24 09:52:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-08bd0077-d296-4648-a760-82677388e6e4 tempest-TestImageHashVerification-1473910708 None] Lock "cinder-e16b523f-84de-43c4-ad66-7fb38eb88f23-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:53:02 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:53:02 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=4,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:53:05 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:53:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Flow 'volume_create_manager' (75166f07-aaf1-48e4-9e9f-89e6184f6a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:53:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418a4113-1f36-4b23-9665-422d4e7f2747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:53:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418a4113-1f36-4b23-9665-422d4e7f2747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd98d82-6431-47e6-aec6-f575d076d532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66eae842500743a2808d0ee568764e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:53:05Z,use_quota=True,user_id='dd6af7cf64d1490ba9ccd3f0cc2b8712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86f7f6a9-6b30-4837-a296-f14614f9450d),volume_type_id=86f7f6a9-6b30-4837-a296-f14614f9450d)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:53:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686a2d44-a999-45b9-9327-8707caeade43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:53:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686a2d44-a999-45b9-9327-8707caeade43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:53:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28dc916c-313c-449c-9945-2c54cb956c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:53:05 devstack cinder-volume[88488]: DEBUG cinder.image.glance [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Creating Keystone auth plugin from conf {{(pid=88488) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 09:53:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28dc916c-313c-449c-9945-2c54cb956c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bfd98d82-6431-47e6-aec6-f575d076d532', 'volume_name': 'volume-bfd98d82-6431-47e6-aec6-f575d076d532', 'volume_size': 1, 'image_id': '1e8bd495-16eb-4034-9875-13302e7f7731', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e8bd495-16eb-4034-9875-13302e7f7731', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01b003fe9c59159a299b8c84664aa0a8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '66eae842500743a2808d0ee568764e6b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01efc39a25d52212e5fcd4671e71f760ff7ce9ed790088b82f3a553d0f264ea4c4c30249227d7e7225da2ad6d46b08e80b3857e3e5fa26a1fece46926d2b22cd', 'id': '1e8bd495-16eb-4034-9875-13302e7f7731', 'created_at': datetime.datetime(2026, 7, 24, 7, 53, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 53, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e8bd495-16eb-4034-9875-13302e7f7731/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:53:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c3be76-8919-4224-973e-0d0dff20c7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:53:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c3be76-8919-4224-973e-0d0dff20c7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:53:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fe499d-f064-42f7-ae10-eeeebd19f899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:53:05 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Volume bfd98d82-6431-47e6-aec6-f575d076d532: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bfd98d82-6431-47e6-aec6-f575d076d532', 'volume_size': 1, 'image_id': '1e8bd495-16eb-4034-9875-13302e7f7731', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e8bd495-16eb-4034-9875-13302e7f7731', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01b003fe9c59159a299b8c84664aa0a8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '66eae842500743a2808d0ee568764e6b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01efc39a25d52212e5fcd4671e71f760ff7ce9ed790088b82f3a553d0f264ea4c4c30249227d7e7225da2ad6d46b08e80b3857e3e5fa26a1fece46926d2b22cd', 'id': '1e8bd495-16eb-4034-9875-13302e7f7731', 'created_at': datetime.datetime(2026, 7, 24, 7, 53, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 53, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e8bd495-16eb-4034-9875-13302e7f7731/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 24 09:53:05 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Trying to clone bfd98d82-6431-47e6-aec6-f575d076d532 from image 1e8bd495-16eb-4034-9875-13302e7f7731 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1e8bd495-16eb-4034-9875-13302e7f7731', 'metadata': {}}]). {{(pid=88488) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 09:53:05 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 09:53:05 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Image download 0.00 MB at 0.00 MB/s Jul 24 09:53:05 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c3611b-0bd1-44d7-aa74-265feb7a68a4]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:53:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:05 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD Jul 24 09:53:05 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:05 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD" returned: 0 in 0.317s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:05 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD Jul 24 09:53:05 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:06 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD" returned: 1 in 0.315s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:53:06 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Temporary image 1e8bd495-16eb-4034-9875-13302e7f7731 is fetched for user dd6af7cf64d1490ba9ccd3f0cc2b8712. {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 09:53:06 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14fe8b5-c00b-45bc-bc67-5745f0a7f9c9]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:53:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:06 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD Jul 24 09:53:06 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:06 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD" returned: 0 in 0.313s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:06 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD Jul 24 09:53:06 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:06 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD" returned: 1 in 0.323s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:53:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:53:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:53:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd98d82-6431-47e6-aec6-f575d076d532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66eae842500743a2808d0ee568764e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:53:05Z,use_quota=True,user_id='dd6af7cf64d1490ba9ccd3f0cc2b8712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86f7f6a9-6b30-4837-a296-f14614f9450d),volume_type_id=86f7f6a9-6b30-4837-a296-f14614f9450d)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:53:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Creating volume bfd98d82-6431-47e6-aec6-f575d076d532 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:53:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:53:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:53:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:53:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:53:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:53:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:53:06 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:53:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bfd98d82-6431-47e6-aec6-f575d076d532 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:06 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bfd98d82-6431-47e6-aec6-f575d076d532 1073741824 Jul 24 09:53:06 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:07 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bfd98d82-6431-47e6-aec6-f575d076d532 1073741824" returned: 0 in 0.407s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bfd98d82-6431-47e6-aec6-f575d076d532 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:07 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bfd98d82-6431-47e6-aec6-f575d076d532 Jul 24 09:53:07 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:07 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bfd98d82-6431-47e6-aec6-f575d076d532" returned: 0 in 0.236s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:53:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:53:07 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Attempting download of 1e8bd495-16eb-4034-9875-13302e7f7731 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e8bd495-16eb-4034-9875-13302e7f7731', 'metadata': {}}])) to volume bfd98d82-6431-47e6-aec6-f575d076d532. {{(pid=88488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 09:53:07 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[031f3261-1e3a-4d33-bd95-f03693e0baf5]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:53:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e8bd495-16eb-4034-9875-13302e7f7731_op0h2q0s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:07 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e8bd495-16eb-4034-9875-13302e7f7731_op0h2q0s Jul 24 09:53:07 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:07 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e8bd495-16eb-4034-9875-13302e7f7731_op0h2q0s" returned: 0 in 0.307s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e8bd495-16eb-4034-9875-13302e7f7731_op0h2q0s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:08 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e8bd495-16eb-4034-9875-13302e7f7731_op0h2q0s Jul 24 09:53:08 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:08 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e8bd495-16eb-4034-9875-13302e7f7731_op0h2q0s" returned: 1 in 0.309s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e8bd495-16eb-4034-9875-13302e7f7731_op0h2q0s' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:53:08 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f503c3f2-a1f1-4609-9ec9-fdb3e14e050b]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:53:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:08 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD Jul 24 09:53:08 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:08 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD" returned: 0 in 0.310s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:08 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD Jul 24 09:53:08 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:08 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD" returned: 1 in 0.312s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:53:08 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] 1e8bd495-16eb-4034-9875-13302e7f7731 was raw, converting to qcow2 {{(pid=88488) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 09:53:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bfd98d82-6431-47e6-aec6-f575d076d532 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:08 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bfd98d82-6431-47e6-aec6-f575d076d532 Jul 24 09:53:08 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:09 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bfd98d82-6431-47e6-aec6-f575d076d532" returned: 0 in 0.419s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:09 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1e8bd495-16eb-4034-9875-13302e7f7731_l5ez6uc3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bfd98d82-6431-47e6-aec6-f575d076d532 {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:53:09 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Converted 0.00 MB image at 0.00 MB/s Jul 24 09:53:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bfd98d82-6431-47e6-aec6-f575d076d532 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:09 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bfd98d82-6431-47e6-aec6-f575d076d532 1G Jul 24 09:53:09 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:09 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bfd98d82-6431-47e6-aec6-f575d076d532 1G" returned: 0 in 0.293s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:09 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Downloaded image 1e8bd495-16eb-4034-9875-13302e7f7731 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e8bd495-16eb-4034-9875-13302e7f7731', 'metadata': {}}])) to volume bfd98d82-6431-47e6-aec6-f575d076d532 successfully. {{(pid=88488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 09:53:09 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Temporary image 1e8bd495-16eb-4034-9875-13302e7f7731 for user dd6af7cf64d1490ba9ccd3f0cc2b8712 is deleted. {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 09:53:09 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Marking volume bfd98d82-6431-47e6-aec6-f575d076d532 as bootable. {{(pid=88488) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 09:53:09 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Copying metadata from image 1e8bd495-16eb-4034-9875-13302e7f7731 to bfd98d82-6431-47e6-aec6-f575d076d532. {{(pid=88488) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 09:53:09 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Creating volume glance metadata for volume bfd98d82-6431-47e6-aec6-f575d076d532 backed by image 1e8bd495-16eb-4034-9875-13302e7f7731 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1e8bd495-16eb-4034-9875-13302e7f7731', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '01b003fe9c59159a299b8c84664aa0a8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88488) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 09:53:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fe499d-f064-42f7-ae10-eeeebd19f899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfd98d82-6431-47e6-aec6-f575d076d532', 'volume_size': 1, 'image_id': '1e8bd495-16eb-4034-9875-13302e7f7731', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e8bd495-16eb-4034-9875-13302e7f7731', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01b003fe9c59159a299b8c84664aa0a8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '66eae842500743a2808d0ee568764e6b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01efc39a25d52212e5fcd4671e71f760ff7ce9ed790088b82f3a553d0f264ea4c4c30249227d7e7225da2ad6d46b08e80b3857e3e5fa26a1fece46926d2b22cd', 'id': '1e8bd495-16eb-4034-9875-13302e7f7731', 'created_at': datetime.datetime(2026, 7, 24, 7, 53, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 53, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e8bd495-16eb-4034-9875-13302e7f7731/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:53:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80e13b6-e0dd-4dd2-85af-cca5b5d07a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:53:09 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Volume volume-bfd98d82-6431-47e6-aec6-f575d076d532 (bfd98d82-6431-47e6-aec6-f575d076d532): created successfully Jul 24 09:53:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80e13b6-e0dd-4dd2-85af-cca5b5d07a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:53:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Flow 'volume_create_manager' (75166f07-aaf1-48e4-9e9f-89e6184f6a0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:53:09 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-430b9b3b-0808-402f-ae87-8a4e51c42df9 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Created volume successfully. Jul 24 09:53:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Acquiring lock "cinder-bfd98d82-6431-47e6-aec6-f575d076d532-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:53:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Lock "cinder-bfd98d82-6431-47e6-aec6-f575d076d532-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:53:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Acquiring lock "cinder-quobyte-bfd98d82-6431-47e6-aec6-f575d076d532" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:53:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Lock "cinder-quobyte-bfd98d82-6431-47e6-aec6-f575d076d532" acquired by "delete_volume" :: waited 0.014s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:53:10 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9812c80-5917-4950-9a08-3bf2f3d349fa]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:53:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bfd98d82-6431-47e6-aec6-f575d076d532 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:10 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bfd98d82-6431-47e6-aec6-f575d076d532 Jul 24 09:53:10 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:10 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bfd98d82-6431-47e6-aec6-f575d076d532" returned: 0 in 0.345s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bfd98d82-6431-47e6-aec6-f575d076d532 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:10 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bfd98d82-6431-47e6-aec6-f575d076d532 Jul 24 09:53:10 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:10 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bfd98d82-6431-47e6-aec6-f575d076d532" returned: 0 in 0.250s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Lock "cinder-quobyte-bfd98d82-6431-47e6-aec6-f575d076d532" released by "delete_volume" :: held 0.632s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:53:11 devstack cinder-volume[88488]: WARNING cinder.quota [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:53:11 devstack cinder-volume[88488]: WARNING cinder.quota [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 24 09:53:11 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Created reservations ['3e8ae028-c3a9-47a4-9dcb-f401ad1f7740', 'e8058407-17df-421d-8482-80a4576513ec', 'ea8955c3-2bef-45b7-9e79-51670e474bfb', '98e04462-1856-4d27-af85-769795f218f2'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:53:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:53:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:53:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:53:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:53:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:53:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:11 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:53:11 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:11 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.242s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:11 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:53:11 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Deleted volume successfully. Jul 24 09:53:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0c67a64d-8024-4fe0-b4fe-47088925dc26 tempest-VolumeAndVolumeTypeFromImageTest-433580661 None] Lock "cinder-bfd98d82-6431-47e6-aec6-f575d076d532-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:53:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:53:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:53:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:53:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:53:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:53:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:53:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:15 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:53:15 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:15 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.264s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:53:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:53:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 28 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:53:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:53:25 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=11,cinder:SELECT=14,cinder:INSERT=8,cinder:DELETE=1 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:53:25 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=13,cinder:INSERT=7,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Flow 'volume_create_manager' (7a9959d1-a8d9-4e62-93f6-ebf9884dad93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (196b6ac8-7840-4bec-a200-8ebfb7acc7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (196b6ac8-7840-4bec-a200-8ebfb7acc7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1576296530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb672268-d11f-40aa-85d5-a129e733e9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbaf3a9358142299c82a3a91d8ee9b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:53:33Z,use_quota=True,user_id='63cebaff6e63496dab13cf9f1218de22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87495b57-1a87-48de-84ae-6f3c37789ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87495b57-1a87-48de-84ae-6f3c37789ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48189fa-b563-47d0-9465-a69879a43c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48189fa-b563-47d0-9465-a69879a43c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb672268-d11f-40aa-85d5-a129e733e9be', 'volume_name': 'volume-cb672268-d11f-40aa-85d5-a129e733e9be', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3c3f5b-08d6-4dee-a529-a70f90d55d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3c3f5b-08d6-4dee-a529-a70f90d55d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a672bd-dc57-4b7e-b340-10d0126e467b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:53:33 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Volume cb672268-d11f-40aa-85d5-a129e733e9be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb672268-d11f-40aa-85d5-a129e733e9be', 'volume_size': 1} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1576296530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb672268-d11f-40aa-85d5-a129e733e9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbaf3a9358142299c82a3a91d8ee9b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:53:33Z,use_quota=True,user_id='63cebaff6e63496dab13cf9f1218de22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Creating volume cb672268-d11f-40aa-85d5-a129e733e9be {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:53:33 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:33 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be 1073741824 Jul 24 09:53:33 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:33 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be 1073741824" returned: 0 in 0.391s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:33 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be Jul 24 09:53:33 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:33 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be" returned: 0 in 0.232s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] <== create_volume: return (662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a672bd-dc57-4b7e-b340-10d0126e467b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb672268-d11f-40aa-85d5-a129e733e9be', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d1b6de-aadf-41c4-adaa-69a643b4b635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:53:33 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Volume volume-cb672268-d11f-40aa-85d5-a129e733e9be (cb672268-d11f-40aa-85d5-a129e733e9be): created successfully Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d1b6de-aadf-41c4-adaa-69a643b4b635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:53:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Flow 'volume_create_manager' (7a9959d1-a8d9-4e62-93f6-ebf9884dad93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:53:33 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-832c8515-d92d-4b66-8e75-02e6ff915702 tempest-SnapshotDependencyTests-167850665 None] Created volume successfully. Jul 24 09:53:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b956936a-16f5-4823-9e6f-db2b2e0ca85b tempest-SnapshotDependencyTests-167850665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:53:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b956936a-16f5-4823-9e6f-db2b2e0ca85b tempest-SnapshotDependencyTests-167850665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:53:34 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-b956936a-16f5-4823-9e6f-db2b2e0ca85b tempest-SnapshotDependencyTests-167850665 None] Creating offline snapshot c4532599-5481-4375-a00a-9c83ad083102 of volume cb672268-d11f-40aa-85d5-a129e733e9be {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:53:34 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4295934-b6da-4aeb-be38-da85168a0256]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:53:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b956936a-16f5-4823-9e6f-db2b2e0ca85b tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:34 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be Jul 24 09:53:34 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:34 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b956936a-16f5-4823-9e6f-db2b2e0ca85b tempest-SnapshotDependencyTests-167850665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be" returned: 0 in 0.353s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b956936a-16f5-4823-9e6f-db2b2e0ca85b tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:34 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102 1G Jul 24 09:53:34 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:35 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b956936a-16f5-4823-9e6f-db2b2e0ca85b tempest-SnapshotDependencyTests-167850665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102 1G" returned: 0 in 0.366s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b956936a-16f5-4823-9e6f-db2b2e0ca85b tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb672268-d11f-40aa-85d5-a129e733e9be -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:35 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb672268-d11f-40aa-85d5-a129e733e9be -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102 Jul 24 09:53:35 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:35 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b956936a-16f5-4823-9e6f-db2b2e0ca85b tempest-SnapshotDependencyTests-167850665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb672268-d11f-40aa-85d5-a129e733e9be -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102" returned: 0 in 0.285s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:35 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-b956936a-16f5-4823-9e6f-db2b2e0ca85b tempest-SnapshotDependencyTests-167850665 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102 is being set with open permissions: ugo+rw Jul 24 09:53:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b956936a-16f5-4823-9e6f-db2b2e0ca85b tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:35 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102 Jul 24 09:53:35 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:35 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b956936a-16f5-4823-9e6f-db2b2e0ca85b tempest-SnapshotDependencyTests-167850665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102" returned: 0 in 0.232s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b956936a-16f5-4823-9e6f-db2b2e0ca85b tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:35 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.info Jul 24 09:53:35 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:35 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b956936a-16f5-4823-9e6f-db2b2e0ca85b tempest-SnapshotDependencyTests-167850665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.info" returned: 0 in 0.236s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:35 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-b956936a-16f5-4823-9e6f-db2b2e0ca85b tempest-SnapshotDependencyTests-167850665 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.info is being set with open permissions: ugo+rw Jul 24 09:53:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b956936a-16f5-4823-9e6f-db2b2e0ca85b tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:35 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.info Jul 24 09:53:35 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:36 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b956936a-16f5-4823-9e6f-db2b2e0ca85b tempest-SnapshotDependencyTests-167850665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.info" returned: 0 in 0.230s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b956936a-16f5-4823-9e6f-db2b2e0ca85b tempest-SnapshotDependencyTests-167850665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.795s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:53:36 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b956936a-16f5-4823-9e6f-db2b2e0ca85b tempest-SnapshotDependencyTests-167850665 None] Create snapshot completed successfully Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Flow 'volume_create_manager' (cb6f1979-0c33-4e54-aabc-d0a4a57d4c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6abc9920-63b8-4ab8-86da-3ef19a73e870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6abc9920-63b8-4ab8-86da-3ef19a73e870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d02ffa9-7f67-4ea8-b56a-66dc300988e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbaf3a9358142299c82a3a91d8ee9b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c4532599-5481-4375-a00a-9c83ad083102,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:53:37Z,use_quota=True,user_id='63cebaff6e63496dab13cf9f1218de22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b7c6b9-8588-4e4e-8d0e-3ca1a1dae46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b7c6b9-8588-4e4e-8d0e-3ca1a1dae46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88bc274a-5042-4e36-b9dd-0b469245bdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88bc274a-5042-4e36-b9dd-0b469245bdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8d02ffa9-7f67-4ea8-b56a-66dc300988e0', 'volume_name': 'volume-8d02ffa9-7f67-4ea8-b56a-66dc300988e0', 'volume_size': 1, 'snapshot_id': 'c4532599-5481-4375-a00a-9c83ad083102'}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd13537d-49f9-42ef-8b15-e23b4c203e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd13537d-49f9-42ef-8b15-e23b4c203e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f431b44-0b77-401e-ae06-4d5917cd083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:53:37 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Volume 8d02ffa9-7f67-4ea8-b56a-66dc300988e0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8d02ffa9-7f67-4ea8-b56a-66dc300988e0', 'volume_size': 1, 'snapshot_id': 'c4532599-5481-4375-a00a-9c83ad083102'} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Acquiring lock "cinder-quobyte-c4532599-5481-4375-a00a-9c83ad083102-8d02ffa9-7f67-4ea8-b56a-66dc300988e0" by "_create_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Lock "cinder-quobyte-c4532599-5481-4375-a00a-9c83ad083102-8d02ffa9-7f67-4ea8-b56a-66dc300988e0" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Creating volume 8d02ffa9-7f67-4ea8-b56a-66dc300988e0 from snapshot c4532599-5481-4375-a00a-9c83ad083102 {{(pid=88488) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Acquiring lock "cinder-quobyte-8d02ffa9-7f67-4ea8-b56a-66dc300988e0" by "_copy_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Lock "cinder-quobyte-8d02ffa9-7f67-4ea8-b56a-66dc300988e0" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] snapshot: c4532599-5481-4375-a00a-9c83ad083102, volume: 8d02ffa9-7f67-4ea8-b56a-66dc300988e0, {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a212d9c7-48fe-4c93-9cf7-32a14cabd5cf]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:37 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102 Jul 24 09:53:37 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:37 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102" returned: 0 in 0.344s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb672268-d11f-40aa-85d5-a129e733e9be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Creating direct copy from snapshot {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6b906c-f754-465b-95da-3e25c07d5853]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:37 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be Jul 24 09:53:37 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:37 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be" returned: 0 in 0.341s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG cinder.utils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Path /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8d02ffa9-7f67-4ea8-b56a-66dc300988e0 not found in is_blk_device check {{(pid=88488) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 09:53:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8d02ffa9-7f67-4ea8-b56a-66dc300988e0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:37 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8d02ffa9-7f67-4ea8-b56a-66dc300988e0 Jul 24 09:53:37 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:41 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8d02ffa9-7f67-4ea8-b56a-66dc300988e0" returned: 0 in 3.929s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:41 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[788c4fa7-54b2-427b-b999-e0b6b4c54796]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:53:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:41 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be Jul 24 09:53:41 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:42 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be" returned: 0 in 0.522s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:42 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be, size 1024.00 MB, duration 3.93 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8d02ffa9-7f67-4ea8-b56a-66dc300988e0 {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:53:42 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Converted 1024.00 MB image at 260.50 MB/s Jul 24 09:53:42 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8d02ffa9-7f67-4ea8-b56a-66dc300988e0 is being set with open permissions: ugo+rw Jul 24 09:53:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8d02ffa9-7f67-4ea8-b56a-66dc300988e0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:42 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8d02ffa9-7f67-4ea8-b56a-66dc300988e0 Jul 24 09:53:42 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:42 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8d02ffa9-7f67-4ea8-b56a-66dc300988e0" returned: 0 in 0.240s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Lock "cinder-quobyte-8d02ffa9-7f67-4ea8-b56a-66dc300988e0" released by "_copy_volume_from_snapshot" :: held 5.459s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:53:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Lock "cinder-quobyte-c4532599-5481-4375-a00a-9c83ad083102-8d02ffa9-7f67-4ea8-b56a-66dc300988e0" released by "_create_volume_from_snapshot" :: held 5.486s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:53:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.500s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:53:42 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f431b44-0b77-401e-ae06-4d5917cd083b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d02ffa9-7f67-4ea8-b56a-66dc300988e0', 'volume_size': 1, 'snapshot_id': 'c4532599-5481-4375-a00a-9c83ad083102'}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:53:42 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0e4b04-95e8-471d-b14e-bda6d46786b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:53:42 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Volume volume-8d02ffa9-7f67-4ea8-b56a-66dc300988e0 (8d02ffa9-7f67-4ea8-b56a-66dc300988e0): created successfully Jul 24 09:53:42 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0e4b04-95e8-471d-b14e-bda6d46786b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:53:42 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Flow 'volume_create_manager' (cb6f1979-0c33-4e54-aabc-d0a4a57d4c26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:53:42 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-fbd4665b-a0f4-447b-8a79-31c411cbdfa0 tempest-SnapshotDependencyTests-167850665 None] Created volume successfully. Jul 24 09:53:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] Acquiring lock "cinder-c4532599-5481-4375-a00a-9c83ad083102-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:53:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] Lock "cinder-c4532599-5481-4375-a00a-9c83ad083102-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:53:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] Acquiring lock "cinder-quobyte-cb672268-d11f-40aa-85d5-a129e733e9be" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:53:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] Lock "cinder-quobyte-cb672268-d11f-40aa-85d5-a129e733e9be" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:53:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] Acquiring lock "cinder-quobyte-c4532599-5481-4375-a00a-9c83ad083102" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:53:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] Lock "cinder-quobyte-c4532599-5481-4375-a00a-9c83ad083102" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:53:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] Deleting offline snapshot c4532599-5481-4375-a00a-9c83ad083102 of volume cb672268-d11f-40aa-85d5-a129e733e9be {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:53:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] snapshot_file for this snap is: volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:53:43 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1354449d-bb3d-49c1-97c8-deaf30360c62]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:53:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:43 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102 Jul 24 09:53:43 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:43 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102" returned: 0 in 0.340s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb672268-d11f-40aa-85d5-a129e733e9be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:53:44 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0f593c-4d64-4cdd-9595-0a0339d023bf]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:53:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:44 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be Jul 24 09:53:44 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:44 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be" returned: 0 in 0.342s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:44 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102 Jul 24 09:53:44 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:44 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102" returned: 0 in 0.327s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:44 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102 Jul 24 09:53:44 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:44 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be.c4532599-5481-4375-a00a-9c83ad083102" returned: 0 in 0.240s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] Lock "cinder-quobyte-c4532599-5481-4375-a00a-9c83ad083102" released by "_delete_snapshot" :: held 1.335s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:53:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] Lock "cinder-quobyte-cb672268-d11f-40aa-85d5-a129e733e9be" released by "delete_snapshot" :: held 1.355s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:53:45 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] Created reservations ['93139f43-5b1c-4bfb-819e-1942adf99be7', '6ab4df5a-6221-4eec-bcbf-89f573ff97c7', '4e8338e4-93cd-4530-ace1-a9a509c596e1', '3eea2cb9-ca5b-4833-b368-316b75b1bc99'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:53:45 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] Delete snapshot completed successfully. Jul 24 09:53:45 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-90ff5d2a-d653-4324-a77d-789edadcafe5 tempest-SnapshotDependencyTests-167850665 None] Lock "cinder-c4532599-5481-4375-a00a-9c83ad083102-delete_snapshot" released by "delete_snapshot" :: held 1.491s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:53:45 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-bcead09e-9c40-41a0-8d92-39321208d89d tempest-SnapshotDependencyTests-167850665 None] Acquiring lock "cinder-cb672268-d11f-40aa-85d5-a129e733e9be-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:53:45 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-bcead09e-9c40-41a0-8d92-39321208d89d tempest-SnapshotDependencyTests-167850665 None] Lock "cinder-cb672268-d11f-40aa-85d5-a129e733e9be-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:53:45 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-bcead09e-9c40-41a0-8d92-39321208d89d tempest-SnapshotDependencyTests-167850665 None] Acquiring lock "cinder-quobyte-cb672268-d11f-40aa-85d5-a129e733e9be" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:53:45 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-bcead09e-9c40-41a0-8d92-39321208d89d tempest-SnapshotDependencyTests-167850665 None] Lock "cinder-quobyte-cb672268-d11f-40aa-85d5-a129e733e9be" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:53:45 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[958a5b52-e3a0-4e9f-aaa6-35f2c912ea67]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:53:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bcead09e-9c40-41a0-8d92-39321208d89d tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:45 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be Jul 24 09:53:45 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:46 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bcead09e-9c40-41a0-8d92-39321208d89d tempest-SnapshotDependencyTests-167850665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be" returned: 0 in 0.345s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bcead09e-9c40-41a0-8d92-39321208d89d tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:46 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be Jul 24 09:53:46 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:46 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bcead09e-9c40-41a0-8d92-39321208d89d tempest-SnapshotDependencyTests-167850665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-cb672268-d11f-40aa-85d5-a129e733e9be" returned: 0 in 0.231s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-bcead09e-9c40-41a0-8d92-39321208d89d tempest-SnapshotDependencyTests-167850665 None] Lock "cinder-quobyte-cb672268-d11f-40aa-85d5-a129e733e9be" released by "delete_volume" :: held 0.633s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:53:46 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-bcead09e-9c40-41a0-8d92-39321208d89d tempest-SnapshotDependencyTests-167850665 None] Created reservations ['09d69d24-52e5-4f32-830f-6a15c0bb2267', 'c8dcd54d-f731-4618-ad97-fa760b74e548', 'c4f0af23-3203-49aa-9a27-b25a4c041e9d', '40eda3dc-c070-4679-bc4c-74fb6ebc314d'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:53:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-bcead09e-9c40-41a0-8d92-39321208d89d tempest-SnapshotDependencyTests-167850665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:53:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-bcead09e-9c40-41a0-8d92-39321208d89d tempest-SnapshotDependencyTests-167850665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:53:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-bcead09e-9c40-41a0-8d92-39321208d89d tempest-SnapshotDependencyTests-167850665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:53:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-bcead09e-9c40-41a0-8d92-39321208d89d tempest-SnapshotDependencyTests-167850665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:53:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-bcead09e-9c40-41a0-8d92-39321208d89d tempest-SnapshotDependencyTests-167850665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:53:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bcead09e-9c40-41a0-8d92-39321208d89d tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:46 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:53:46 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:46 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bcead09e-9c40-41a0-8d92-39321208d89d tempest-SnapshotDependencyTests-167850665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.233s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:46 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-bcead09e-9c40-41a0-8d92-39321208d89d tempest-SnapshotDependencyTests-167850665 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:53:46 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-bcead09e-9c40-41a0-8d92-39321208d89d tempest-SnapshotDependencyTests-167850665 None] Deleted volume successfully. Jul 24 09:53:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-bcead09e-9c40-41a0-8d92-39321208d89d tempest-SnapshotDependencyTests-167850665 None] Lock "cinder-cb672268-d11f-40aa-85d5-a129e733e9be-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:53:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-df863d66-67c9-4ac3-aa5e-f07a9dce252c tempest-SnapshotDependencyTests-167850665 None] Acquiring lock "cinder-8d02ffa9-7f67-4ea8-b56a-66dc300988e0-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:53:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-df863d66-67c9-4ac3-aa5e-f07a9dce252c tempest-SnapshotDependencyTests-167850665 None] Lock "cinder-8d02ffa9-7f67-4ea8-b56a-66dc300988e0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:53:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-df863d66-67c9-4ac3-aa5e-f07a9dce252c tempest-SnapshotDependencyTests-167850665 None] Acquiring lock "cinder-quobyte-8d02ffa9-7f67-4ea8-b56a-66dc300988e0" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:53:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-df863d66-67c9-4ac3-aa5e-f07a9dce252c tempest-SnapshotDependencyTests-167850665 None] Lock "cinder-quobyte-8d02ffa9-7f67-4ea8-b56a-66dc300988e0" acquired by "delete_volume" :: waited 0.014s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:53:46 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bc540c-30c7-413b-8e25-c6af89427d87]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:53:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-df863d66-67c9-4ac3-aa5e-f07a9dce252c tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8d02ffa9-7f67-4ea8-b56a-66dc300988e0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:47 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8d02ffa9-7f67-4ea8-b56a-66dc300988e0 Jul 24 09:53:47 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:47 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-df863d66-67c9-4ac3-aa5e-f07a9dce252c tempest-SnapshotDependencyTests-167850665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8d02ffa9-7f67-4ea8-b56a-66dc300988e0" returned: 0 in 0.351s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-df863d66-67c9-4ac3-aa5e-f07a9dce252c tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8d02ffa9-7f67-4ea8-b56a-66dc300988e0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:47 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8d02ffa9-7f67-4ea8-b56a-66dc300988e0 Jul 24 09:53:47 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:47 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-df863d66-67c9-4ac3-aa5e-f07a9dce252c tempest-SnapshotDependencyTests-167850665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-8d02ffa9-7f67-4ea8-b56a-66dc300988e0" returned: 0 in 0.244s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-df863d66-67c9-4ac3-aa5e-f07a9dce252c tempest-SnapshotDependencyTests-167850665 None] Lock "cinder-quobyte-8d02ffa9-7f67-4ea8-b56a-66dc300988e0" released by "delete_volume" :: held 0.635s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:53:47 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-df863d66-67c9-4ac3-aa5e-f07a9dce252c tempest-SnapshotDependencyTests-167850665 None] Created reservations ['5b79ec14-5a86-4917-9f22-ec7eef4bc476', '5892630f-7981-463d-b9d5-a75cc57d84a9', 'bec986ef-0d3b-4870-8f1a-9834c873e1c3', '5566ff8f-69a8-4efa-8ea2-8f035e8199bd'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:53:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-df863d66-67c9-4ac3-aa5e-f07a9dce252c tempest-SnapshotDependencyTests-167850665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:53:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-df863d66-67c9-4ac3-aa5e-f07a9dce252c tempest-SnapshotDependencyTests-167850665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:53:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-df863d66-67c9-4ac3-aa5e-f07a9dce252c tempest-SnapshotDependencyTests-167850665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:53:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-df863d66-67c9-4ac3-aa5e-f07a9dce252c tempest-SnapshotDependencyTests-167850665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:53:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-df863d66-67c9-4ac3-aa5e-f07a9dce252c tempest-SnapshotDependencyTests-167850665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:53:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-df863d66-67c9-4ac3-aa5e-f07a9dce252c tempest-SnapshotDependencyTests-167850665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:53:47 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:53:47 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:53:47 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jul 24 09:53:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-df863d66-67c9-4ac3-aa5e-f07a9dce252c tempest-SnapshotDependencyTests-167850665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.245s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:53:47 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-df863d66-67c9-4ac3-aa5e-f07a9dce252c tempest-SnapshotDependencyTests-167850665 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:53:47 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-df863d66-67c9-4ac3-aa5e-f07a9dce252c tempest-SnapshotDependencyTests-167850665 None] Deleted volume successfully. Jul 24 09:53:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-df863d66-67c9-4ac3-aa5e-f07a9dce252c tempest-SnapshotDependencyTests-167850665 None] Lock "cinder-8d02ffa9-7f67-4ea8-b56a-66dc300988e0-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:53:57 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:DELETE=2,cinder:INSERT=5 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:53:57 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=30,cinder:SELECT=23,cinder:INSERT=9,cinder:DELETE=3 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Flow 'volume_create_manager' (fb13fa60-626f-45dd-b522-7e4ccc0cff3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c767a5-b011-4eeb-9cda-9bbb297775a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c767a5-b011-4eeb-9cda-9bbb297775a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-245750896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771aa255-1551-4d5b-bfe7-33b25f6dbcb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f4d7340ea4992849dbd7612dbdf9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:06Z,use_quota=True,user_id='d025070e283a4f1d86e05475952d27cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef602425-129e-422c-a83e-cf1327d5f138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef602425-129e-422c-a83e-cf1327d5f138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f816f33-6334-4072-88a2-f135ec1a7131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f816f33-6334-4072-88a2-f135ec1a7131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '771aa255-1551-4d5b-bfe7-33b25f6dbcb2', 'volume_name': 'volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac2e48d-583e-4c2b-9652-dd9a1c7f5432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac2e48d-583e-4c2b-9652-dd9a1c7f5432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7ecf10-16c2-400c-8a4f-21a5dc7362c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:06 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Volume 771aa255-1551-4d5b-bfe7-33b25f6dbcb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2', 'volume_size': 1} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-245750896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771aa255-1551-4d5b-bfe7-33b25f6dbcb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f4d7340ea4992849dbd7612dbdf9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:06Z,use_quota=True,user_id='d025070e283a4f1d86e05475952d27cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Creating volume 771aa255-1551-4d5b-bfe7-33b25f6dbcb2 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:06 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:06 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2 1073741824 Jul 24 09:54:06 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Flow 'volume_create_manager' (d5e496fe-ded6-4bbe-b4d0-becea8f9660f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b230f1-0be9-4d99-9d32-2b6b2909ea85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b230f1-0be9-4d99-9d32-2b6b2909ea85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1419430512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1eb099-c67b-42f6-bc01-59aee1988028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6299f86fdc764ff681f828d8fcc084e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:06Z,use_quota=True,user_id='7216a26aed1c43028d22971437ad5c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ded019c-93c7-4f42-8f76-c8ce55dda34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ded019c-93c7-4f42-8f76-c8ce55dda34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ea4d79-8709-4308-87cd-7e936ccae679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ea4d79-8709-4308-87cd-7e936ccae679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f1eb099-c67b-42f6-bc01-59aee1988028', 'volume_name': 'volume-2f1eb099-c67b-42f6-bc01-59aee1988028', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (034371b9-e8ea-4541-9cf4-119f985ba47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (034371b9-e8ea-4541-9cf4-119f985ba47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e92534b-077e-41e6-bcdb-ecc3f3d2d0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:06 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Volume 2f1eb099-c67b-42f6-bc01-59aee1988028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f1eb099-c67b-42f6-bc01-59aee1988028', 'volume_size': 1} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Flow 'volume_create_manager' (96328f55-badf-49bc-8bc4-1a8c86fa0277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d9c00d-85e4-4fb7-9343-df276508c2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d9c00d-85e4-4fb7-9343-df276508c2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1669510368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0041e83c-047e-44c0-a129-6e6242d1b543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6299f86fdc764ff681f828d8fcc084e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:07Z,use_quota=True,user_id='7216a26aed1c43028d22971437ad5c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad3c258-3d0a-4246-9588-7b9dd246e148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad3c258-3d0a-4246-9588-7b9dd246e148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db28e32-bc94-42ef-ba93-ab7b3670007f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db28e32-bc94-42ef-ba93-ab7b3670007f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0041e83c-047e-44c0-a129-6e6242d1b543', 'volume_name': 'volume-0041e83c-047e-44c0-a129-6e6242d1b543', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1569315-5a06-4a9e-9e75-0e277ae52f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1569315-5a06-4a9e-9e75-0e277ae52f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81efb1a8-1817-4bec-9e4f-a52b0c721392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:06 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Volume 0041e83c-047e-44c0-a129-6e6242d1b543: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0041e83c-047e-44c0-a129-6e6242d1b543', 'volume_size': 1} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:06 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2 1073741824" returned: 0 in 0.705s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:06 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2 Jul 24 09:54:06 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Flow 'volume_create_manager' (c6a23da3-6507-4ece-9ab0-5bd7bcee7ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12e6eef-d129-46ad-ad0f-e6cd74343189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12e6eef-d129-46ad-ad0f-e6cd74343189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1438782572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d80b5b6d-c049-4386-80d0-db9d4b482cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6299f86fdc764ff681f828d8fcc084e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:07Z,use_quota=True,user_id='7216a26aed1c43028d22971437ad5c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7ba2df-634e-46c7-ae47-e4a661bf3abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7ba2df-634e-46c7-ae47-e4a661bf3abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d73d69-9180-473d-9739-aa6b53d3c9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d73d69-9180-473d-9739-aa6b53d3c9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd80b5b6d-c049-4386-80d0-db9d4b482cca', 'volume_name': 'volume-d80b5b6d-c049-4386-80d0-db9d4b482cca', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7855f2d4-c12f-4d7d-bad0-4b6e94640732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7855f2d4-c12f-4d7d-bad0-4b6e94640732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52209247-ecf0-4e9e-88a3-e0088f257834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:07 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Volume d80b5b6d-c049-4386-80d0-db9d4b482cca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d80b5b6d-c049-4386-80d0-db9d4b482cca', 'volume_size': 1} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:07 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2" returned: 0 in 0.404s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.702s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1419430512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1eb099-c67b-42f6-bc01-59aee1988028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6299f86fdc764ff681f828d8fcc084e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:06Z,use_quota=True,user_id='7216a26aed1c43028d22971437ad5c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Creating volume 2f1eb099-c67b-42f6-bc01-59aee1988028 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:07 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2f1eb099-c67b-42f6-bc01-59aee1988028 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7ecf10-16c2-400c-8a4f-21a5dc7362c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9b7c85-9c01-46d4-ae6f-d4a25de23389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:07 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2f1eb099-c67b-42f6-bc01-59aee1988028 1073741824 Jul 24 09:54:07 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:07 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Volume volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2 (771aa255-1551-4d5b-bfe7-33b25f6dbcb2): created successfully Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9b7c85-9c01-46d4-ae6f-d4a25de23389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Flow 'volume_create_manager' (fb13fa60-626f-45dd-b522-7e4ccc0cff3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:07 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-575e3c3f-8251-42ab-b402-76cd7820a390 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Created volume successfully. Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Flow 'volume_create_manager' (17731054-a262-411d-83ff-27866f7c3190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21892fa9-a1b9-4acf-95d8-aeaed654ae35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21892fa9-a1b9-4acf-95d8-aeaed654ae35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2043965622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344b1217-710f-4c6e-9c58-d1636ae07902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6299f86fdc764ff681f828d8fcc084e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:07Z,use_quota=True,user_id='7216a26aed1c43028d22971437ad5c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a66a840-bc40-4b03-9e5f-8145d2b74c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a66a840-bc40-4b03-9e5f-8145d2b74c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41664a2c-9b9f-43f6-be23-2213bca08a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41664a2c-9b9f-43f6-be23-2213bca08a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '344b1217-710f-4c6e-9c58-d1636ae07902', 'volume_name': 'volume-344b1217-710f-4c6e-9c58-d1636ae07902', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b16667d-2290-4de7-8d3f-85d2253a5550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b16667d-2290-4de7-8d3f-85d2253a5550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23dbab9-7483-4f81-a8f8-4a01987976da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:07 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Volume 344b1217-710f-4c6e-9c58-d1636ae07902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-344b1217-710f-4c6e-9c58-d1636ae07902', 'volume_size': 1} Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:07 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2f1eb099-c67b-42f6-bc01-59aee1988028 1073741824" returned: 0 in 0.621s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Flow 'volume_create_manager' (d1a8428d-5283-4f7c-afac-545cddd1db94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5d007e-f51e-484e-bb2c-f7ae82be25ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5d007e-f51e-484e-bb2c-f7ae82be25ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1960191004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b0b76b-eb41-445e-8cb7-50e5e8494dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6299f86fdc764ff681f828d8fcc084e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:08Z,use_quota=True,user_id='7216a26aed1c43028d22971437ad5c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb670e0-1df6-4d66-a75c-307bb61001c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb670e0-1df6-4d66-a75c-307bb61001c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45fe58e-2a54-4eff-ba35-1fb56e0deb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45fe58e-2a54-4eff-ba35-1fb56e0deb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5b0b76b-eb41-445e-8cb7-50e5e8494dd5', 'volume_name': 'volume-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef88c85-95d9-4409-b362-5d7543cc13f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef88c85-95d9-4409-b362-5d7543cc13f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d790d6-3b9c-4026-8484-fa7c20dd0dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:08 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Volume f5b0b76b-eb41-445e-8cb7-50e5e8494dd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5', 'volume_size': 1} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2f1eb099-c67b-42f6-bc01-59aee1988028 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:08 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2f1eb099-c67b-42f6-bc01-59aee1988028 Jul 24 09:54:08 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-bfe81bdb-acb3-4ed0-a43c-5a3a8f713a46 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:08 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2f1eb099-c67b-42f6-bc01-59aee1988028" returned: 0 in 0.403s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.717s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1669510368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0041e83c-047e-44c0-a129-6e6242d1b543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6299f86fdc764ff681f828d8fcc084e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:07Z,use_quota=True,user_id='7216a26aed1c43028d22971437ad5c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Creating volume 0041e83c-047e-44c0-a129-6e6242d1b543 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:08 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0041e83c-047e-44c0-a129-6e6242d1b543 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e92534b-077e-41e6-bcdb-ecc3f3d2d0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f1eb099-c67b-42f6-bc01-59aee1988028', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c49cd9b-5ade-40db-a706-94f2dd53badf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:08 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0041e83c-047e-44c0-a129-6e6242d1b543 1073741824 Jul 24 09:54:08 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:08 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Volume volume-2f1eb099-c67b-42f6-bc01-59aee1988028 (2f1eb099-c67b-42f6-bc01-59aee1988028): created successfully Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c49cd9b-5ade-40db-a706-94f2dd53badf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:08 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Flow 'volume_create_manager' (d5e496fe-ded6-4bbe-b4d0-becea8f9660f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:08 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d3de1e3c-0c05-4bef-885a-1796d451ddb4 tempest-CreateVolumesFromImageTest-305141596 None] Created volume successfully. Jul 24 09:54:09 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0041e83c-047e-44c0-a129-6e6242d1b543 1073741824" returned: 0 in 0.545s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0041e83c-047e-44c0-a129-6e6242d1b543 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:09 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0041e83c-047e-44c0-a129-6e6242d1b543 Jul 24 09:54:09 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Flow 'volume_create_manager' (84c75ecc-6e73-4aa3-a276-bcd62d3fcb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ec021e-8fc6-459f-9f5a-415e87ec56ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ec021e-8fc6-459f-9f5a-415e87ec56ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164f33fb2abd47ff9dc90e461a46c61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:09Z,use_quota=True,user_id='2a1e3623cc2040f6bc97fb6b588e6491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2d439b-37f4-4848-8c21-d3bd1b2bc520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2d439b-37f4-4848-8c21-d3bd1b2bc520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c8a6e3-85a1-4fd2-93b6-0f2e323be36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.image.glance [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Creating Keystone auth plugin from conf {{(pid=88488) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 09:54:09 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0041e83c-047e-44c0-a129-6e6242d1b543" returned: 0 in 0.288s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.233s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1438782572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d80b5b6d-c049-4386-80d0-db9d4b482cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6299f86fdc764ff681f828d8fcc084e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:07Z,use_quota=True,user_id='7216a26aed1c43028d22971437ad5c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Creating volume d80b5b6d-c049-4386-80d0-db9d4b482cca {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:09 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d80b5b6d-c049-4386-80d0-db9d4b482cca 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81efb1a8-1817-4bec-9e4f-a52b0c721392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0041e83c-047e-44c0-a129-6e6242d1b543', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92121b5-e6ab-4fe2-baa4-8b0ae1a81c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:09 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d80b5b6d-c049-4386-80d0-db9d4b482cca 1073741824 Jul 24 09:54:09 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:09 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Volume volume-0041e83c-047e-44c0-a129-6e6242d1b543 (0041e83c-047e-44c0-a129-6e6242d1b543): created successfully Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92121b5-e6ab-4fe2-baa4-8b0ae1a81c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Flow 'volume_create_manager' (96328f55-badf-49bc-8bc4-1a8c86fa0277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:09 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b385e916-a5e5-449c-8cbe-1b6a77c1292d tempest-CreateVolumesFromImageTest-305141596 None] Created volume successfully. Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c8a6e3-85a1-4fd2-93b6-0f2e323be36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3', 'volume_name': 'volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3', 'volume_size': 1, 'image_id': 'b7fcc3de-e529-475f-ae26-d542d92ae446', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7fcc3de-e529-475f-ae26-d542d92ae446', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7fea8d9aff359b28f5b89228c9e5390', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '164f33fb2abd47ff9dc90e461a46c61e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '813fddb7ec3dfee9ca2f0549dcce408265c12dd62a80d85a25c20d179797b85495c71a41efb1949580ccca9f80ba5fa0f8623f4782c4ee7a8be3388aeefcdbc8', 'id': 'b7fcc3de-e529-475f-ae26-d542d92ae446', 'created_at': datetime.datetime(2026, 7, 24, 7, 54, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 54, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7fcc3de-e529-475f-ae26-d542d92ae446/file', 'properties': {}}, 'image_service': }' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec3ce76-731b-4231-a7f8-05c8d603981a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec3ce76-731b-4231-a7f8-05c8d603981a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5f9f5a-53b1-4b3c-a193-c4685dcc8c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:09 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Volume 1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3', 'volume_size': 1, 'image_id': 'b7fcc3de-e529-475f-ae26-d542d92ae446', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7fcc3de-e529-475f-ae26-d542d92ae446', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7fea8d9aff359b28f5b89228c9e5390', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '164f33fb2abd47ff9dc90e461a46c61e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '813fddb7ec3dfee9ca2f0549dcce408265c12dd62a80d85a25c20d179797b85495c71a41efb1949580ccca9f80ba5fa0f8623f4782c4ee7a8be3388aeefcdbc8', 'id': 'b7fcc3de-e529-475f-ae26-d542d92ae446', 'created_at': datetime.datetime(2026, 7, 24, 7, 54, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 54, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7fcc3de-e529-475f-ae26-d542d92ae446/file', 'properties': {}}, 'image_service': } Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Trying to clone 1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 from image b7fcc3de-e529-475f-ae26-d542d92ae446 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b7fcc3de-e529-475f-ae26-d542d92ae446', 'metadata': {}}]). {{(pid=88488) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 09:54:09 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Image download 0.00 MB at 0.00 MB/s Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd8af51-d751-45b1-b1f4-25a024ec412e]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:09 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD Jul 24 09:54:09 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:09 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d80b5b6d-c049-4386-80d0-db9d4b482cca 1073741824" returned: 0 in 0.502s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d80b5b6d-c049-4386-80d0-db9d4b482cca {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:10 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d80b5b6d-c049-4386-80d0-db9d4b482cca Jul 24 09:54:10 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:10 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:10 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d80b5b6d-c049-4386-80d0-db9d4b482cca" returned: 0 in 0.270s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.685s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2043965622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344b1217-710f-4c6e-9c58-d1636ae07902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6299f86fdc764ff681f828d8fcc084e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:07Z,use_quota=True,user_id='7216a26aed1c43028d22971437ad5c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Creating volume 344b1217-710f-4c6e-9c58-d1636ae07902 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:10 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-344b1217-710f-4c6e-9c58-d1636ae07902 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52209247-ecf0-4e9e-88a3-e0088f257834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d80b5b6d-c049-4386-80d0-db9d4b482cca', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:10 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD Jul 24 09:54:10 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e74c2b-6158-420f-9e6f-df4dbea346b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:10 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-344b1217-710f-4c6e-9c58-d1636ae07902 1073741824 Jul 24 09:54:10 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:10 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Volume volume-d80b5b6d-c049-4386-80d0-db9d4b482cca (d80b5b6d-c049-4386-80d0-db9d4b482cca): created successfully Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e74c2b-6158-420f-9e6f-df4dbea346b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Flow 'volume_create_manager' (c6a23da3-6507-4ece-9ab0-5bd7bcee7ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:10 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-68a84060-3e9e-4d5a-8e68-caddb65ca55f tempest-CreateVolumesFromImageTest-305141596 None] Created volume successfully. Jul 24 09:54:10 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD" returned: 1 in 0.376s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Temporary image b7fcc3de-e529-475f-ae26-d542d92ae446 is fetched for user 2a1e3623cc2040f6bc97fb6b588e6491. {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Flow 'volume_create_manager' (1f5c08f2-fcea-4b7c-a30c-c266d7fe0ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33fea1f4-2228-4ab4-b17b-bc9c900936c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2500801e-35e3-4b28-8b56-78f20560efa3]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33fea1f4-2228-4ab4-b17b-bc9c900936c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a02998f0-1145-421d-81af-2f195c84f555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443e43d05d5541309b2f5db37549d740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:11Z,use_quota=True,user_id='6946f7d154eb4eae87af317a9ade8e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0545da33-ddd2-47bf-9e27-40213c470326),volume_type_id=0545da33-ddd2-47bf-9e27-40213c470326)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f745e679-ec9c-446c-bb91-64758c738989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f745e679-ec9c-446c-bb91-64758c738989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e57fe7a-914e-463b-8eed-70ea3f3372ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.image.glance [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Creating Keystone auth plugin from conf {{(pid=88488) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 09:54:10 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD Jul 24 09:54:10 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:10 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-344b1217-710f-4c6e-9c58-d1636ae07902 1073741824" returned: 0 in 0.528s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-344b1217-710f-4c6e-9c58-d1636ae07902 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:10 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-344b1217-710f-4c6e-9c58-d1636ae07902 Jul 24 09:54:10 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e57fe7a-914e-463b-8eed-70ea3f3372ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a02998f0-1145-421d-81af-2f195c84f555', 'volume_name': 'volume-a02998f0-1145-421d-81af-2f195c84f555', 'volume_size': 1, 'image_id': 'b631e4b0-98bd-4600-ad85-98b3cde8fec7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b631e4b0-98bd-4600-ad85-98b3cde8fec7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c0fa91524759d3f815b8fb55372f664', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '443e43d05d5541309b2f5db37549d740', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '06c6bca19b93d2a290f0997f6a0cfdcad1d97eac927997858195521988797d854f464e06017f9e4d7d818516fa6f88bb948de4282e62c1e192cb3ae53afe9a13', 'id': 'b631e4b0-98bd-4600-ad85-98b3cde8fec7', 'created_at': datetime.datetime(2026, 7, 24, 7, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b631e4b0-98bd-4600-ad85-98b3cde8fec7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ee3c43-8893-4fbb-8682-b4e583c72648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ee3c43-8893-4fbb-8682-b4e583c72648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6aec6b5-ae63-479e-a66a-cfc66265ad18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:11 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Volume a02998f0-1145-421d-81af-2f195c84f555: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a02998f0-1145-421d-81af-2f195c84f555', 'volume_size': 1, 'image_id': 'b631e4b0-98bd-4600-ad85-98b3cde8fec7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b631e4b0-98bd-4600-ad85-98b3cde8fec7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c0fa91524759d3f815b8fb55372f664', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '443e43d05d5541309b2f5db37549d740', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '06c6bca19b93d2a290f0997f6a0cfdcad1d97eac927997858195521988797d854f464e06017f9e4d7d818516fa6f88bb948de4282e62c1e192cb3ae53afe9a13', 'id': 'b631e4b0-98bd-4600-ad85-98b3cde8fec7', 'created_at': datetime.datetime(2026, 7, 24, 7, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b631e4b0-98bd-4600-ad85-98b3cde8fec7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Trying to clone a02998f0-1145-421d-81af-2f195c84f555 from image b631e4b0-98bd-4600-ad85-98b3cde8fec7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b631e4b0-98bd-4600-ad85-98b3cde8fec7', 'metadata': {}}]). {{(pid=88488) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 09:54:11 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD" returned: 0 in 0.365s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 09:54:11 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Image download 0.00 MB at 0.00 MB/s Jul 24 09:54:11 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-344b1217-710f-4c6e-9c58-d1636ae07902" returned: 0 in 0.274s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1960191004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b0b76b-eb41-445e-8cb7-50e5e8494dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6299f86fdc764ff681f828d8fcc084e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:08Z,use_quota=True,user_id='7216a26aed1c43028d22971437ad5c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Creating volume f5b0b76b-eb41-445e-8cb7-50e5e8494dd5 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:11 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:11 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5 1073741824 Jul 24 09:54:11 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23dbab9-7483-4f81-a8f8-4a01987976da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-344b1217-710f-4c6e-9c58-d1636ae07902', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:11 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD Jul 24 09:54:11 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bf56ba-18be-418a-8367-2c49e784635d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[372eb890-080f-4b3c-b5f2-becf7a29f09c]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:11 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Volume volume-344b1217-710f-4c6e-9c58-d1636ae07902 (344b1217-710f-4c6e-9c58-d1636ae07902): created successfully Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bf56ba-18be-418a-8367-2c49e784635d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Flow 'volume_create_manager' (17731054-a262-411d-83ff-27866f7c3190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:11 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-7eef0383-16b2-4a1a-96bb-54253117a3cb tempest-CreateVolumesFromImageTest-305141596 None] Created volume successfully. Jul 24 09:54:11 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD Jul 24 09:54:11 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:11 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD" returned: 1 in 0.414s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:11 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:11 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5 1073741824" returned: 0 in 0.515s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:11 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD Jul 24 09:54:11 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:11 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5 Jul 24 09:54:11 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:11 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD" returned: 1 in 0.335s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Temporary image b631e4b0-98bd-4600-ad85-98b3cde8fec7 is fetched for user 6946f7d154eb4eae87af317a9ade8e64. {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 09:54:11 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5" returned: 0 in 0.246s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-bfe81bdb-acb3-4ed0-a43c-5a3a8f713a46 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.597s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d790d6-3b9c-4026-8484-fa7c20dd0dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d89d3b5-a9c0-4adc-bc31-afd7acd86df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-bfe81bdb-acb3-4ed0-a43c-5a3a8f713a46 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Creating offline snapshot 1e027aca-f32f-4fe5-af6c-d66f976e6d5b of volume 771aa255-1551-4d5b-bfe7-33b25f6dbcb2 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:54:11 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Volume volume-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5 (f5b0b76b-eb41-445e-8cb7-50e5e8494dd5): created successfully Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d89d3b5-a9c0-4adc-bc31-afd7acd86df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Flow 'volume_create_manager' (d1a8428d-5283-4f7c-afac-545cddd1db94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b8b1a6-be1c-424f-9fb2-7eadd45d695a]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bfe81bdb-acb3-4ed0-a43c-5a3a8f713a46 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1a6775-602e-41d0-acbc-4e6b57d3aa40]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:12 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-08c36dfd-5dc9-48e4-ab47-29eee0420a57 tempest-CreateVolumesFromImageTest-305141596 None] Created volume successfully. Jul 24 09:54:12 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2 Jul 24 09:54:12 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:12 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD Jul 24 09:54:12 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:12 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:12 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bfe81bdb-acb3-4ed0-a43c-5a3a8f713a46 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2" returned: 0 in 0.371s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bfe81bdb-acb3-4ed0-a43c-5a3a8f713a46 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.1e027aca-f32f-4fe5-af6c-d66f976e6d5b 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:12 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.1e027aca-f32f-4fe5-af6c-d66f976e6d5b 1G Jul 24 09:54:12 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cf2a362f-b3cc-4a01-929b-cc25ae638d7e tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "cinder-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cf2a362f-b3cc-4a01-929b-cc25ae638d7e tempest-CreateVolumesFromImageTest-305141596 None] Lock "cinder-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:12 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD Jul 24 09:54:12 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cf2a362f-b3cc-4a01-929b-cc25ae638d7e tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "cinder-quobyte-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cf2a362f-b3cc-4a01-929b-cc25ae638d7e tempest-CreateVolumesFromImageTest-305141596 None] Lock "cinder-quobyte-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5" acquired by "delete_volume" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49129b5-a596-410a-9632-4669a2bfe7b5]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cf2a362f-b3cc-4a01-929b-cc25ae638d7e tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:12 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5 Jul 24 09:54:12 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:12 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:12 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bfe81bdb-acb3-4ed0-a43c-5a3a8f713a46 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.1e027aca-f32f-4fe5-af6c-d66f976e6d5b 1G" returned: 0 in 0.433s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bfe81bdb-acb3-4ed0-a43c-5a3a8f713a46 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.1e027aca-f32f-4fe5-af6c-d66f976e6d5b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:12 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.1e027aca-f32f-4fe5-af6c-d66f976e6d5b Jul 24 09:54:12 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:12 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cf2a362f-b3cc-4a01-929b-cc25ae638d7e tempest-CreateVolumesFromImageTest-305141596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5" returned: 0 in 0.376s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cf2a362f-b3cc-4a01-929b-cc25ae638d7e tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:12 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5 Jul 24 09:54:12 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:13 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bfe81bdb-acb3-4ed0-a43c-5a3a8f713a46 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.1e027aca-f32f-4fe5-af6c-d66f976e6d5b" returned: 0 in 0.296s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:13 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-bfe81bdb-acb3-4ed0-a43c-5a3a8f713a46 tempest-CreateVolumesFromSnapshotTest-1816288595 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.1e027aca-f32f-4fe5-af6c-d66f976e6d5b is being set with open permissions: ugo+rw Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bfe81bdb-acb3-4ed0-a43c-5a3a8f713a46 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.1e027aca-f32f-4fe5-af6c-d66f976e6d5b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:13 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.1e027aca-f32f-4fe5-af6c-d66f976e6d5b Jul 24 09:54:13 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:13 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cf2a362f-b3cc-4a01-929b-cc25ae638d7e tempest-CreateVolumesFromImageTest-305141596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5" returned: 0 in 0.255s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cf2a362f-b3cc-4a01-929b-cc25ae638d7e tempest-CreateVolumesFromImageTest-305141596 None] Lock "cinder-quobyte-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5" released by "delete_volume" :: held 0.677s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-cf2a362f-b3cc-4a01-929b-cc25ae638d7e tempest-CreateVolumesFromImageTest-305141596 None] Created reservations ['e33faab3-6cf3-4416-b5b3-29bae8d5d1fc', '2c61e781-4c34-49bc-9210-caf0cf4bd0f6', '1ef31c0c-1cac-4e62-8bc1-967114c1f827', '141d4897-30c8-49d2-895f-75d1dcc11d8a'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cf2a362f-b3cc-4a01-929b-cc25ae638d7e tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cf2a362f-b3cc-4a01-929b-cc25ae638d7e tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cf2a362f-b3cc-4a01-929b-cc25ae638d7e tempest-CreateVolumesFromImageTest-305141596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cf2a362f-b3cc-4a01-929b-cc25ae638d7e tempest-CreateVolumesFromImageTest-305141596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cf2a362f-b3cc-4a01-929b-cc25ae638d7e tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cf2a362f-b3cc-4a01-929b-cc25ae638d7e tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:13 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bfe81bdb-acb3-4ed0-a43c-5a3a8f713a46 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.1e027aca-f32f-4fe5-af6c-d66f976e6d5b" returned: 0 in 0.263s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:13 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:13 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bfe81bdb-acb3-4ed0-a43c-5a3a8f713a46 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:13 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.info Jul 24 09:54:13 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:13 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cf2a362f-b3cc-4a01-929b-cc25ae638d7e tempest-CreateVolumesFromImageTest-305141596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.255s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-cf2a362f-b3cc-4a01-929b-cc25ae638d7e tempest-CreateVolumesFromImageTest-305141596 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:13 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-cf2a362f-b3cc-4a01-929b-cc25ae638d7e tempest-CreateVolumesFromImageTest-305141596 None] Deleted volume successfully. Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a4bcd161-b4c9-42c9-b2f4-4716acc98734 tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "cinder-344b1217-710f-4c6e-9c58-d1636ae07902-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a4bcd161-b4c9-42c9-b2f4-4716acc98734 tempest-CreateVolumesFromImageTest-305141596 None] Lock "cinder-344b1217-710f-4c6e-9c58-d1636ae07902-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cf2a362f-b3cc-4a01-929b-cc25ae638d7e tempest-CreateVolumesFromImageTest-305141596 None] Lock "cinder-f5b0b76b-eb41-445e-8cb7-50e5e8494dd5-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a4bcd161-b4c9-42c9-b2f4-4716acc98734 tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "cinder-quobyte-344b1217-710f-4c6e-9c58-d1636ae07902" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:13 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bfe81bdb-acb3-4ed0-a43c-5a3a8f713a46 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.info" returned: 0 in 0.292s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:13 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-bfe81bdb-acb3-4ed0-a43c-5a3a8f713a46 tempest-CreateVolumesFromSnapshotTest-1816288595 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.info is being set with open permissions: ugo+rw Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bfe81bdb-acb3-4ed0-a43c-5a3a8f713a46 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a4bcd161-b4c9-42c9-b2f4-4716acc98734 tempest-CreateVolumesFromImageTest-305141596 None] Lock "cinder-quobyte-344b1217-710f-4c6e-9c58-d1636ae07902" acquired by "delete_volume" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:13 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.info Jul 24 09:54:13 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0904f01-919b-437a-a775-80a55715ea97]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a4bcd161-b4c9-42c9-b2f4-4716acc98734 tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-344b1217-710f-4c6e-9c58-d1636ae07902 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:13 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-344b1217-710f-4c6e-9c58-d1636ae07902 Jul 24 09:54:13 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:13 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-bfe81bdb-acb3-4ed0-a43c-5a3a8f713a46 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.info" returned: 0 in 0.255s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-bfe81bdb-acb3-4ed0-a43c-5a3a8f713a46 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.530s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164f33fb2abd47ff9dc90e461a46c61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:09Z,use_quota=True,user_id='2a1e3623cc2040f6bc97fb6b588e6491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Creating volume 1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:14 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:14 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 1073741824 Jul 24 09:54:14 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:14 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-bfe81bdb-acb3-4ed0-a43c-5a3a8f713a46 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Create snapshot completed successfully Jul 24 09:54:14 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a4bcd161-b4c9-42c9-b2f4-4716acc98734 tempest-CreateVolumesFromImageTest-305141596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-344b1217-710f-4c6e-9c58-d1636ae07902" returned: 0 in 0.366s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a4bcd161-b4c9-42c9-b2f4-4716acc98734 tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-344b1217-710f-4c6e-9c58-d1636ae07902 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:14 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-344b1217-710f-4c6e-9c58-d1636ae07902 Jul 24 09:54:14 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:14 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a4bcd161-b4c9-42c9-b2f4-4716acc98734 tempest-CreateVolumesFromImageTest-305141596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-344b1217-710f-4c6e-9c58-d1636ae07902" returned: 0 in 0.261s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a4bcd161-b4c9-42c9-b2f4-4716acc98734 tempest-CreateVolumesFromImageTest-305141596 None] Lock "cinder-quobyte-344b1217-710f-4c6e-9c58-d1636ae07902" released by "delete_volume" :: held 0.672s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:14 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 1073741824" returned: 0 in 0.424s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-a4bcd161-b4c9-42c9-b2f4-4716acc98734 tempest-CreateVolumesFromImageTest-305141596 None] Created reservations ['4fce4628-38e8-4a95-b02c-56955c0880bc', 'a85efdc2-81a6-4a07-bd8d-51bb7d640f13', 'd5dcf7f8-e3c4-49d0-92cc-18526f6d12f1', '5d4d58f1-bb5c-41ac-93b2-ca8a0ae49b93'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:14 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 Jul 24 09:54:14 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a4bcd161-b4c9-42c9-b2f4-4716acc98734 tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a4bcd161-b4c9-42c9-b2f4-4716acc98734 tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a4bcd161-b4c9-42c9-b2f4-4716acc98734 tempest-CreateVolumesFromImageTest-305141596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a4bcd161-b4c9-42c9-b2f4-4716acc98734 tempest-CreateVolumesFromImageTest-305141596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a4bcd161-b4c9-42c9-b2f4-4716acc98734 tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a4bcd161-b4c9-42c9-b2f4-4716acc98734 tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:14 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:14 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:14 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3" returned: 0 in 0.258s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.969s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a02998f0-1145-421d-81af-2f195c84f555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443e43d05d5541309b2f5db37549d740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:11Z,use_quota=True,user_id='6946f7d154eb4eae87af317a9ade8e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0545da33-ddd2-47bf-9e27-40213c470326),volume_type_id=0545da33-ddd2-47bf-9e27-40213c470326)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Creating volume a02998f0-1145-421d-81af-2f195c84f555 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:14 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a02998f0-1145-421d-81af-2f195c84f555 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Attempting download of b7fcc3de-e529-475f-ae26-d542d92ae446 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7fcc3de-e529-475f-ae26-d542d92ae446', 'metadata': {}}])) to volume 1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3. {{(pid=88488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 09:54:14 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a02998f0-1145-421d-81af-2f195c84f555 1073741824 Jul 24 09:54:14 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:14 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a4bcd161-b4c9-42c9-b2f4-4716acc98734 tempest-CreateVolumesFromImageTest-305141596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.302s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-a4bcd161-b4c9-42c9-b2f4-4716acc98734 tempest-CreateVolumesFromImageTest-305141596 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:14 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-a4bcd161-b4c9-42c9-b2f4-4716acc98734 tempest-CreateVolumesFromImageTest-305141596 None] Deleted volume successfully. Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d08778-ad2a-406a-8475-51a2def3d538]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7fcc3de-e529-475f-ae26-d542d92ae446_55iqlbu4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-afc0c98b-4317-4e6a-96ac-d5ab17466b28 tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "cinder-d80b5b6d-c049-4386-80d0-db9d4b482cca-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a4bcd161-b4c9-42c9-b2f4-4716acc98734 tempest-CreateVolumesFromImageTest-305141596 None] Lock "cinder-344b1217-710f-4c6e-9c58-d1636ae07902-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-afc0c98b-4317-4e6a-96ac-d5ab17466b28 tempest-CreateVolumesFromImageTest-305141596 None] Lock "cinder-d80b5b6d-c049-4386-80d0-db9d4b482cca-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:14 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-afc0c98b-4317-4e6a-96ac-d5ab17466b28 tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "cinder-quobyte-d80b5b6d-c049-4386-80d0-db9d4b482cca" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-afc0c98b-4317-4e6a-96ac-d5ab17466b28 tempest-CreateVolumesFromImageTest-305141596 None] Lock "cinder-quobyte-d80b5b6d-c049-4386-80d0-db9d4b482cca" acquired by "delete_volume" :: waited 0.021s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:15 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7fcc3de-e529-475f-ae26-d542d92ae446_55iqlbu4 Jul 24 09:54:15 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe194f2e-fa7c-4f17-ab6d-6c0f3afdbda1]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-afc0c98b-4317-4e6a-96ac-d5ab17466b28 tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d80b5b6d-c049-4386-80d0-db9d4b482cca {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:15 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:15 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:15 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d80b5b6d-c049-4386-80d0-db9d4b482cca Jul 24 09:54:15 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:15 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:15 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a02998f0-1145-421d-81af-2f195c84f555 1073741824" returned: 0 in 0.646s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.389s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:15 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7fcc3de-e529-475f-ae26-d542d92ae446_55iqlbu4" returned: 0 in 0.594s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7fcc3de-e529-475f-ae26-d542d92ae446_55iqlbu4 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 28 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Flow 'volume_create_manager' (5a5da2f5-3870-42a4-867e-b5e3d7556728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ede3f2-211e-4d24-84ef-8eebbb4b12df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ede3f2-211e-4d24-84ef-8eebbb4b12df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1311045691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ffce1ef-0118-42b9-8bd9-710ce8c25e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f4d7340ea4992849dbd7612dbdf9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:15Z,use_quota=True,user_id='d025070e283a4f1d86e05475952d27cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e948f3-fa1c-479f-a470-9d990a4468c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e948f3-fa1c-479f-a470-9d990a4468c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7947f0c3-dfcc-45e6-967d-b54e06831a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7947f0c3-dfcc-45e6-967d-b54e06831a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ffce1ef-0118-42b9-8bd9-710ce8c25e61', 'volume_name': 'volume-1ffce1ef-0118-42b9-8bd9-710ce8c25e61', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:15 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7fcc3de-e529-475f-ae26-d542d92ae446_55iqlbu4 Jul 24 09:54:15 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818fcc2e-3719-450d-b258-d347af0ae067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818fcc2e-3719-450d-b258-d347af0ae067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776ab481-bc6f-4c84-b9ac-cfca6d99cd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:15 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Volume 1ffce1ef-0118-42b9-8bd9-710ce8c25e61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ffce1ef-0118-42b9-8bd9-710ce8c25e61', 'volume_size': 1} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a02998f0-1145-421d-81af-2f195c84f555 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:15 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-afc0c98b-4317-4e6a-96ac-d5ab17466b28 tempest-CreateVolumesFromImageTest-305141596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d80b5b6d-c049-4386-80d0-db9d4b482cca" returned: 0 in 0.585s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-afc0c98b-4317-4e6a-96ac-d5ab17466b28 tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d80b5b6d-c049-4386-80d0-db9d4b482cca {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:15 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a02998f0-1145-421d-81af-2f195c84f555 Jul 24 09:54:15 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:15 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d80b5b6d-c049-4386-80d0-db9d4b482cca Jul 24 09:54:15 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:15 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7fcc3de-e529-475f-ae26-d542d92ae446_55iqlbu4" returned: 1 in 0.412s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7fcc3de-e529-475f-ae26-d542d92ae446_55iqlbu4' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88f0f0a-c187-4c1c-a3a0-682d9b00b38c]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:15 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Flow 'volume_create_manager' (26b76717-1db0-4d1c-a73b-fb10f581532a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:16 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce29c3c8-c298-4fa8-bdf0-df2c66f249e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:16 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-afc0c98b-4317-4e6a-96ac-d5ab17466b28 tempest-CreateVolumesFromImageTest-305141596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d80b5b6d-c049-4386-80d0-db9d4b482cca" returned: 0 in 0.366s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a02998f0-1145-421d-81af-2f195c84f555" returned: 0 in 0.404s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-afc0c98b-4317-4e6a-96ac-d5ab17466b28 tempest-CreateVolumesFromImageTest-305141596 None] Lock "cinder-quobyte-d80b5b6d-c049-4386-80d0-db9d4b482cca" released by "delete_volume" :: held 1.042s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.419s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1311045691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ffce1ef-0118-42b9-8bd9-710ce8c25e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f4d7340ea4992849dbd7612dbdf9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:15Z,use_quota=True,user_id='d025070e283a4f1d86e05475952d27cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Creating volume 1ffce1ef-0118-42b9-8bd9-710ce8c25e61 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:16 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ffce1ef-0118-42b9-8bd9-710ce8c25e61 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:16 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD Jul 24 09:54:16 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce29c3c8-c298-4fa8-bdf0-df2c66f249e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1694152077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96867cda-142e-444b-aeb9-32174b584681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f4d7340ea4992849dbd7612dbdf9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:16Z,use_quota=True,user_id='d025070e283a4f1d86e05475952d27cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:16 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ffce1ef-0118-42b9-8bd9-710ce8c25e61 1073741824 Jul 24 09:54:16 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a9cbcf-5252-4de6-860a-f3a7d1bbe48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a9cbcf-5252-4de6-860a-f3a7d1bbe48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7e290c-0378-4126-adf5-d4035db32909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7e290c-0378-4126-adf5-d4035db32909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96867cda-142e-444b-aeb9-32174b584681', 'volume_name': 'volume-96867cda-142e-444b-aeb9-32174b584681', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1791ed4-f8e7-4b24-944e-c7344f9b69bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1791ed4-f8e7-4b24-944e-c7344f9b69bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec0b348-c4fc-450a-88a7-31d77e0619dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:16 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Volume 96867cda-142e-444b-aeb9-32174b584681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96867cda-142e-444b-aeb9-32174b584681', 'volume_size': 1} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Attempting download of b631e4b0-98bd-4600-ad85-98b3cde8fec7 ((None, [{'url': 'file:///opt/stack/data/glance/images/b631e4b0-98bd-4600-ad85-98b3cde8fec7', 'metadata': {}}])) to volume a02998f0-1145-421d-81af-2f195c84f555. {{(pid=88488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-afc0c98b-4317-4e6a-96ac-d5ab17466b28 tempest-CreateVolumesFromImageTest-305141596 None] Created reservations ['b4df9b27-9bfc-4264-a4e1-dc4303d19c47', '377fa593-6c68-49a8-a119-ab2a67e9bc89', '70fd39c8-579a-41c9-b145-c0d03a7b1478', '2f428098-9393-4dcb-b208-0d8f2d3fc82c'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d32826-ce50-4a9b-8d52-5fa287e58c29]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b631e4b0-98bd-4600-ad85-98b3cde8fec7_q9z62att {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-afc0c98b-4317-4e6a-96ac-d5ab17466b28 tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-afc0c98b-4317-4e6a-96ac-d5ab17466b28 tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-afc0c98b-4317-4e6a-96ac-d5ab17466b28 tempest-CreateVolumesFromImageTest-305141596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-afc0c98b-4317-4e6a-96ac-d5ab17466b28 tempest-CreateVolumesFromImageTest-305141596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-afc0c98b-4317-4e6a-96ac-d5ab17466b28 tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-afc0c98b-4317-4e6a-96ac-d5ab17466b28 tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:16 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD" returned: 0 in 0.463s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:16 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:16 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:16 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b631e4b0-98bd-4600-ad85-98b3cde8fec7_q9z62att Jul 24 09:54:16 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:16 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD Jul 24 09:54:16 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:16 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-afc0c98b-4317-4e6a-96ac-d5ab17466b28 tempest-CreateVolumesFromImageTest-305141596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.371s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-afc0c98b-4317-4e6a-96ac-d5ab17466b28 tempest-CreateVolumesFromImageTest-305141596 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:16 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-afc0c98b-4317-4e6a-96ac-d5ab17466b28 tempest-CreateVolumesFromImageTest-305141596 None] Deleted volume successfully. Jul 24 09:54:16 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Flow 'volume_create_manager' (0a34b532-c802-48d6-9758-bf9a3e380bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:16 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e178fe-596a-4548-a0d4-b1558f7af51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ffce1ef-0118-42b9-8bd9-710ce8c25e61 1073741824" returned: 0 in 0.761s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b631e4b0-98bd-4600-ad85-98b3cde8fec7_q9z62att" returned: 0 in 0.566s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:16 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b631e4b0-98bd-4600-ad85-98b3cde8fec7_q9z62att {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e178fe-596a-4548-a0d4-b1558f7af51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1460883768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87db6f36-9207-4e12-98c2-4206bd2171cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f4d7340ea4992849dbd7612dbdf9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:17Z,use_quota=True,user_id='d025070e283a4f1d86e05475952d27cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf51949f-8155-45aa-9bff-712a832a9b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf51949f-8155-45aa-9bff-712a832a9b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e8f0b6-0393-49d9-bc82-f169f7d2e266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e8f0b6-0393-49d9-bc82-f169f7d2e266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87db6f36-9207-4e12-98c2-4206bd2171cf', 'volume_name': 'volume-87db6f36-9207-4e12-98c2-4206bd2171cf', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21515c6e-66ae-4739-9de4-9f0fef179381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21515c6e-66ae-4739-9de4-9f0fef179381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5849693b-09ce-4cb6-89b7-a22f7853eb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:16 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Volume 87db6f36-9207-4e12-98c2-4206bd2171cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87db6f36-9207-4e12-98c2-4206bd2171cf', 'volume_size': 1} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-afc0c98b-4317-4e6a-96ac-d5ab17466b28 tempest-CreateVolumesFromImageTest-305141596 None] Lock "cinder-d80b5b6d-c049-4386-80d0-db9d4b482cca-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD" returned: 1 in 0.551s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] b7fcc3de-e529-475f-ae26-d542d92ae446 was raw, converting to qcow2 {{(pid=88488) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 09:54:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:16 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b631e4b0-98bd-4600-ad85-98b3cde8fec7_q9z62att Jul 24 09:54:16 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:16 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 Jul 24 09:54:17 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ffce1ef-0118-42b9-8bd9-710ce8c25e61 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:17 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ffce1ef-0118-42b9-8bd9-710ce8c25e61 Jul 24 09:54:17 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Flow 'volume_create_manager' (a2f49c24-f287-4a44-82d0-77000d84fe77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c988a98-10a4-4026-a6cc-165761c5010b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-984ad951-4b18-4b04-8bd2-c1d7eb04c50b tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "cinder-0041e83c-047e-44c0-a129-6e6242d1b543-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:17 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b631e4b0-98bd-4600-ad85-98b3cde8fec7_q9z62att" returned: 1 in 0.444s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b631e4b0-98bd-4600-ad85-98b3cde8fec7_q9z62att' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa674935-944f-4666-8abc-1b81d3df666d]: (4, 'raw') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c988a98-10a4-4026-a6cc-165761c5010b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1835186574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=305101e5-9b8d-4dbf-890c-f5334833f3a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f4d7340ea4992849dbd7612dbdf9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:17Z,use_quota=True,user_id='d025070e283a4f1d86e05475952d27cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d45d6e-e335-4578-9f1d-198e787eec37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d45d6e-e335-4578-9f1d-198e787eec37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2baaee34-244d-4e45-9874-2b07cb75b20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2baaee34-244d-4e45-9874-2b07cb75b20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '305101e5-9b8d-4dbf-890c-f5334833f3a0', 'volume_name': 'volume-305101e5-9b8d-4dbf-890c-f5334833f3a0', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a625881c-ae36-4ae1-804c-fa6b91d751c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a625881c-ae36-4ae1-804c-fa6b91d751c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e23e9bb-cb67-493b-903a-37e11968a125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:17 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Volume 305101e5-9b8d-4dbf-890c-f5334833f3a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-305101e5-9b8d-4dbf-890c-f5334833f3a0', 'volume_size': 1} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-984ad951-4b18-4b04-8bd2-c1d7eb04c50b tempest-CreateVolumesFromImageTest-305141596 None] Lock "cinder-0041e83c-047e-44c0-a129-6e6242d1b543-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-984ad951-4b18-4b04-8bd2-c1d7eb04c50b tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "cinder-quobyte-0041e83c-047e-44c0-a129-6e6242d1b543" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-984ad951-4b18-4b04-8bd2-c1d7eb04c50b tempest-CreateVolumesFromImageTest-305141596 None] Lock "cinder-quobyte-0041e83c-047e-44c0-a129-6e6242d1b543" acquired by "delete_volume" :: waited 0.029s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:17 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ffce1ef-0118-42b9-8bd9-710ce8c25e61" returned: 0 in 0.460s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a043e22-9f77-46e4-8838-3ed09fc13d25]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.361s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1694152077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96867cda-142e-444b-aeb9-32174b584681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f4d7340ea4992849dbd7612dbdf9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:16Z,use_quota=True,user_id='d025070e283a4f1d86e05475952d27cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Creating volume 96867cda-142e-444b-aeb9-32174b584681 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:17 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96867cda-142e-444b-aeb9-32174b584681 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-984ad951-4b18-4b04-8bd2-c1d7eb04c50b tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0041e83c-047e-44c0-a129-6e6242d1b543 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:17 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD Jul 24 09:54:17 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:17 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96867cda-142e-444b-aeb9-32174b584681 1073741824 Jul 24 09:54:17 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776ab481-bc6f-4c84-b9ac-cfca6d99cd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ffce1ef-0118-42b9-8bd9-710ce8c25e61', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf960369-7177-417f-9b65-6cd594242a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:17 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Volume volume-1ffce1ef-0118-42b9-8bd9-710ce8c25e61 (1ffce1ef-0118-42b9-8bd9-710ce8c25e61): created successfully Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf960369-7177-417f-9b65-6cd594242a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Flow 'volume_create_manager' (5a5da2f5-3870-42a4-867e-b5e3d7556728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:17 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0041e83c-047e-44c0-a129-6e6242d1b543 Jul 24 09:54:17 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:17 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-78eb1b75-0948-4e86-b581-f32f9d141e95 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Created volume successfully. Jul 24 09:54:17 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3" returned: 0 in 0.799s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b7fcc3de-e529-475f-ae26-d542d92ae446_bwjk79j_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:54:17 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Converted 0.00 MB image at 0.00 MB/s Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:17 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 1G Jul 24 09:54:17 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:17 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Flow 'volume_create_manager' (57605de9-8f69-424d-9eaa-27da11157394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a63ad6-29ce-4a47-83c5-fbf747259971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a63ad6-29ce-4a47-83c5-fbf747259971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1881554123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f4d7340ea4992849dbd7612dbdf9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:18Z,use_quota=True,user_id='d025070e283a4f1d86e05475952d27cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f55aeca-7436-46bb-8f33-38ac0a270831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f55aeca-7436-46bb-8f33-38ac0a270831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90995d9c-150f-4f57-999f-ee419d80e6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90995d9c-150f-4f57-999f-ee419d80e6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd', 'volume_name': 'volume-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488bc8d8-38c7-4e07-9918-3152f48fae2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488bc8d8-38c7-4e07-9918-3152f48fae2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67c3a77-cd29-4e6b-bfd6-4d5c66d5c1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:18 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Volume b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd', 'volume_size': 1} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:18 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD Jul 24 09:54:18 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:18 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-984ad951-4b18-4b04-8bd2-c1d7eb04c50b tempest-CreateVolumesFromImageTest-305141596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0041e83c-047e-44c0-a129-6e6242d1b543" returned: 0 in 0.530s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-984ad951-4b18-4b04-8bd2-c1d7eb04c50b tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0041e83c-047e-44c0-a129-6e6242d1b543 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:18 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0041e83c-047e-44c0-a129-6e6242d1b543 Jul 24 09:54:18 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:18 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96867cda-142e-444b-aeb9-32174b584681 1073741824" returned: 0 in 0.634s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96867cda-142e-444b-aeb9-32174b584681 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:18 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 1G" returned: 0 in 0.459s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Downloaded image b7fcc3de-e529-475f-ae26-d542d92ae446 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7fcc3de-e529-475f-ae26-d542d92ae446', 'metadata': {}}])) to volume 1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 successfully. {{(pid=88488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Temporary image b7fcc3de-e529-475f-ae26-d542d92ae446 for user 2a1e3623cc2040f6bc97fb6b588e6491 is deleted. {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Marking volume 1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 as bootable. {{(pid=88488) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Copying metadata from image b7fcc3de-e529-475f-ae26-d542d92ae446 to 1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3. {{(pid=88488) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Creating volume glance metadata for volume 1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 backed by image b7fcc3de-e529-475f-ae26-d542d92ae446 with: {'image_id': 'b7fcc3de-e529-475f-ae26-d542d92ae446', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c7fea8d9aff359b28f5b89228c9e5390', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88488) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 09:54:18 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96867cda-142e-444b-aeb9-32174b584681 Jul 24 09:54:18 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:18 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5f9f5a-53b1-4b3c-a193-c4685dcc8c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3', 'volume_size': 1, 'image_id': 'b7fcc3de-e529-475f-ae26-d542d92ae446', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7fcc3de-e529-475f-ae26-d542d92ae446', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7fea8d9aff359b28f5b89228c9e5390', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '164f33fb2abd47ff9dc90e461a46c61e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '813fddb7ec3dfee9ca2f0549dcce408265c12dd62a80d85a25c20d179797b85495c71a41efb1949580ccca9f80ba5fa0f8623f4782c4ee7a8be3388aeefcdbc8', 'id': 'b7fcc3de-e529-475f-ae26-d542d92ae446', 'created_at': datetime.datetime(2026, 7, 24, 7, 54, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 54, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7fcc3de-e529-475f-ae26-d542d92ae446/file', 'properties': {}}, 'image_service': }' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d70e36e-8a52-4862-a13b-f1b8a42d029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD" returned: 1 in 0.438s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] b631e4b0-98bd-4600-ad85-98b3cde8fec7 was raw, converting to qcow2 {{(pid=88488) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a02998f0-1145-421d-81af-2f195c84f555 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:18 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Volume volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 (1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3): created successfully Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d70e36e-8a52-4862-a13b-f1b8a42d029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Flow 'volume_create_manager' (84c75ecc-6e73-4aa3-a276-bcd62d3fcb09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:18 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a02998f0-1145-421d-81af-2f195c84f555 Jul 24 09:54:18 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:18 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-39a1c528-7f25-4ef8-b2c4-09420abbcc1e tempest-VolumeImageDependencyTests-740372535 None] Created volume successfully. Jul 24 09:54:18 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-984ad951-4b18-4b04-8bd2-c1d7eb04c50b tempest-CreateVolumesFromImageTest-305141596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-0041e83c-047e-44c0-a129-6e6242d1b543" returned: 0 in 0.323s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-984ad951-4b18-4b04-8bd2-c1d7eb04c50b tempest-CreateVolumesFromImageTest-305141596 None] Lock "cinder-quobyte-0041e83c-047e-44c0-a129-6e6242d1b543" released by "delete_volume" :: held 0.968s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-984ad951-4b18-4b04-8bd2-c1d7eb04c50b tempest-CreateVolumesFromImageTest-305141596 None] Created reservations ['b0871756-3dac-4f33-8ac5-560fea67cbbc', '684d4b2c-04c4-4c98-a9c3-7bcd5a251970', '6ef88faa-2cbc-46bd-a93e-fdeeb8f1b680', '29c6c065-a5d4-48cf-af4c-62af8b8be280'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:18 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96867cda-142e-444b-aeb9-32174b584681" returned: 0 in 0.315s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.611s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1460883768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87db6f36-9207-4e12-98c2-4206bd2171cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f4d7340ea4992849dbd7612dbdf9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:17Z,use_quota=True,user_id='d025070e283a4f1d86e05475952d27cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Creating volume 87db6f36-9207-4e12-98c2-4206bd2171cf {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:18 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87db6f36-9207-4e12-98c2-4206bd2171cf 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-984ad951-4b18-4b04-8bd2-c1d7eb04c50b tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-984ad951-4b18-4b04-8bd2-c1d7eb04c50b tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-984ad951-4b18-4b04-8bd2-c1d7eb04c50b tempest-CreateVolumesFromImageTest-305141596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-984ad951-4b18-4b04-8bd2-c1d7eb04c50b tempest-CreateVolumesFromImageTest-305141596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-984ad951-4b18-4b04-8bd2-c1d7eb04c50b tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-984ad951-4b18-4b04-8bd2-c1d7eb04c50b tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:18 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87db6f36-9207-4e12-98c2-4206bd2171cf 1073741824 Jul 24 09:54:18 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec0b348-c4fc-450a-88a7-31d77e0619dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96867cda-142e-444b-aeb9-32174b584681', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff52aa8-d525-4079-a818-7a7c3dbf2eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:18 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:18 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:18 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Volume volume-96867cda-142e-444b-aeb9-32174b584681 (96867cda-142e-444b-aeb9-32174b584681): created successfully Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff52aa8-d525-4079-a818-7a7c3dbf2eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Flow 'volume_create_manager' (26b76717-1db0-4d1c-a73b-fb10f581532a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:18 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-6fd67c1d-b720-454e-baea-307d7e8e558e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Created volume successfully. Jul 24 09:54:18 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-984ad951-4b18-4b04-8bd2-c1d7eb04c50b tempest-CreateVolumesFromImageTest-305141596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.320s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-984ad951-4b18-4b04-8bd2-c1d7eb04c50b tempest-CreateVolumesFromImageTest-305141596 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:18 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-984ad951-4b18-4b04-8bd2-c1d7eb04c50b tempest-CreateVolumesFromImageTest-305141596 None] Deleted volume successfully. Jul 24 09:54:18 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a02998f0-1145-421d-81af-2f195c84f555" returned: 0 in 0.569s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b631e4b0-98bd-4600-ad85-98b3cde8fec7_b45q652tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a02998f0-1145-421d-81af-2f195c84f555 {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:54:18 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Converted 0.00 MB image at 0.00 MB/s Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a02998f0-1145-421d-81af-2f195c84f555 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:18 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a02998f0-1145-421d-81af-2f195c84f555 1G Jul 24 09:54:18 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:18 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-984ad951-4b18-4b04-8bd2-c1d7eb04c50b tempest-CreateVolumesFromImageTest-305141596 None] Lock "cinder-0041e83c-047e-44c0-a129-6e6242d1b543-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:19 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87db6f36-9207-4e12-98c2-4206bd2171cf 1073741824" returned: 0 in 0.497s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eb35394b-eb1a-4326-b8be-bad362d49e5d tempest-VolumeImageDependencyTests-740372535 None] Acquiring lock "cinder-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87db6f36-9207-4e12-98c2-4206bd2171cf {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:19 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87db6f36-9207-4e12-98c2-4206bd2171cf Jul 24 09:54:19 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eb35394b-eb1a-4326-b8be-bad362d49e5d tempest-VolumeImageDependencyTests-740372535 None] Lock "cinder-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eb35394b-eb1a-4326-b8be-bad362d49e5d tempest-VolumeImageDependencyTests-740372535 None] Acquiring lock "cinder-quobyte-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eb35394b-eb1a-4326-b8be-bad362d49e5d tempest-VolumeImageDependencyTests-740372535 None] Lock "cinder-quobyte-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bbd4cc-a455-48c1-9de6-b3d57271bf31]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eb35394b-eb1a-4326-b8be-bad362d49e5d tempest-VolumeImageDependencyTests-740372535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:19 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a02998f0-1145-421d-81af-2f195c84f555 1G" returned: 0 in 0.368s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Downloaded image b631e4b0-98bd-4600-ad85-98b3cde8fec7 ((None, [{'url': 'file:///opt/stack/data/glance/images/b631e4b0-98bd-4600-ad85-98b3cde8fec7', 'metadata': {}}])) to volume a02998f0-1145-421d-81af-2f195c84f555 successfully. {{(pid=88488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Temporary image b631e4b0-98bd-4600-ad85-98b3cde8fec7 for user 6946f7d154eb4eae87af317a9ade8e64 is deleted. {{(pid=88488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.volume.volume_utils [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Marking volume a02998f0-1145-421d-81af-2f195c84f555 as bootable. {{(pid=88488) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Copying metadata from image b631e4b0-98bd-4600-ad85-98b3cde8fec7 to a02998f0-1145-421d-81af-2f195c84f555. {{(pid=88488) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Creating volume glance metadata for volume a02998f0-1145-421d-81af-2f195c84f555 backed by image b631e4b0-98bd-4600-ad85-98b3cde8fec7 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b631e4b0-98bd-4600-ad85-98b3cde8fec7', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9c0fa91524759d3f815b8fb55372f664', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88488) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 09:54:19 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 Jul 24 09:54:19 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6aec6b5-ae63-479e-a66a-cfc66265ad18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a02998f0-1145-421d-81af-2f195c84f555', 'volume_size': 1, 'image_id': 'b631e4b0-98bd-4600-ad85-98b3cde8fec7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b631e4b0-98bd-4600-ad85-98b3cde8fec7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c0fa91524759d3f815b8fb55372f664', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '443e43d05d5541309b2f5db37549d740', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '06c6bca19b93d2a290f0997f6a0cfdcad1d97eac927997858195521988797d854f464e06017f9e4d7d818516fa6f88bb948de4282e62c1e192cb3ae53afe9a13', 'id': 'b631e4b0-98bd-4600-ad85-98b3cde8fec7', 'created_at': datetime.datetime(2026, 7, 24, 7, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 7, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b631e4b0-98bd-4600-ad85-98b3cde8fec7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900c99ee-bcdb-4826-9298-52b19b321f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:19 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87db6f36-9207-4e12-98c2-4206bd2171cf" returned: 0 in 0.298s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.025s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1835186574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=305101e5-9b8d-4dbf-890c-f5334833f3a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f4d7340ea4992849dbd7612dbdf9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:17Z,use_quota=True,user_id='d025070e283a4f1d86e05475952d27cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Creating volume 305101e5-9b8d-4dbf-890c-f5334833f3a0 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:19 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-305101e5-9b8d-4dbf-890c-f5334833f3a0 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:19 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Volume volume-a02998f0-1145-421d-81af-2f195c84f555 (a02998f0-1145-421d-81af-2f195c84f555): created successfully Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900c99ee-bcdb-4826-9298-52b19b321f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Flow 'volume_create_manager' (1f5c08f2-fcea-4b7c-a30c-c266d7fe0ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:19 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-305101e5-9b8d-4dbf-890c-f5334833f3a0 1073741824 Jul 24 09:54:19 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5849693b-09ce-4cb6-89b7-a22f7853eb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87db6f36-9207-4e12-98c2-4206bd2171cf', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7992842-9eb3-4e5a-b21b-ff207273f1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:19 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-aec7015b-ae01-4045-9527-88cd7ab97a85 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Created volume successfully. Jul 24 09:54:19 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Volume volume-87db6f36-9207-4e12-98c2-4206bd2171cf (87db6f36-9207-4e12-98c2-4206bd2171cf): created successfully Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7992842-9eb3-4e5a-b21b-ff207273f1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Flow 'volume_create_manager' (0a34b532-c802-48d6-9758-bf9a3e380bb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:19 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-2f2cd6d9-e4a9-4424-88f4-b7ea606c28be tempest-CreateVolumesFromSnapshotTest-1816288595 None] Created volume successfully. Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f9dc43f5-8936-4242-a39a-83cf4b022ef5 tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "cinder-2f1eb099-c67b-42f6-bc01-59aee1988028-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f9dc43f5-8936-4242-a39a-83cf4b022ef5 tempest-CreateVolumesFromImageTest-305141596 None] Lock "cinder-2f1eb099-c67b-42f6-bc01-59aee1988028-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f9dc43f5-8936-4242-a39a-83cf4b022ef5 tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "cinder-quobyte-2f1eb099-c67b-42f6-bc01-59aee1988028" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f9dc43f5-8936-4242-a39a-83cf4b022ef5 tempest-CreateVolumesFromImageTest-305141596 None] Lock "cinder-quobyte-2f1eb099-c67b-42f6-bc01-59aee1988028" acquired by "delete_volume" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da9f3f9-d1e6-44a7-b620-8000416a9d17]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f9dc43f5-8936-4242-a39a-83cf4b022ef5 tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2f1eb099-c67b-42f6-bc01-59aee1988028 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:19 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eb35394b-eb1a-4326-b8be-bad362d49e5d tempest-VolumeImageDependencyTests-740372535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3" returned: 0 in 0.419s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eb35394b-eb1a-4326-b8be-bad362d49e5d tempest-VolumeImageDependencyTests-740372535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:19 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3 Jul 24 09:54:19 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:19 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2f1eb099-c67b-42f6-bc01-59aee1988028 Jul 24 09:54:19 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:19 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-305101e5-9b8d-4dbf-890c-f5334833f3a0 1073741824" returned: 0 in 0.472s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-305101e5-9b8d-4dbf-890c-f5334833f3a0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:19 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eb35394b-eb1a-4326-b8be-bad362d49e5d tempest-VolumeImageDependencyTests-740372535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3" returned: 0 in 0.288s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eb35394b-eb1a-4326-b8be-bad362d49e5d tempest-VolumeImageDependencyTests-740372535 None] Lock "cinder-quobyte-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3" released by "delete_volume" :: held 0.756s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:19 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-305101e5-9b8d-4dbf-890c-f5334833f3a0 Jul 24 09:54:19 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:19 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-eb35394b-eb1a-4326-b8be-bad362d49e5d tempest-VolumeImageDependencyTests-740372535 None] Created reservations ['77043cbc-184a-4cba-9778-17ae4b80858c', 'd128f132-9ca1-4bf2-aa44-b76bd9f7d918', 'fc73117d-ac56-4c4d-80f5-7a9260910c8c', '3148c924-88c5-42c7-a88e-23d9a410a4cd'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:19 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f9dc43f5-8936-4242-a39a-83cf4b022ef5 tempest-CreateVolumesFromImageTest-305141596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2f1eb099-c67b-42f6-bc01-59aee1988028" returned: 0 in 0.389s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f9dc43f5-8936-4242-a39a-83cf4b022ef5 tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2f1eb099-c67b-42f6-bc01-59aee1988028 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:20 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2f1eb099-c67b-42f6-bc01-59aee1988028 Jul 24 09:54:20 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-eb35394b-eb1a-4326-b8be-bad362d49e5d tempest-VolumeImageDependencyTests-740372535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-eb35394b-eb1a-4326-b8be-bad362d49e5d tempest-VolumeImageDependencyTests-740372535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-eb35394b-eb1a-4326-b8be-bad362d49e5d tempest-VolumeImageDependencyTests-740372535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-eb35394b-eb1a-4326-b8be-bad362d49e5d tempest-VolumeImageDependencyTests-740372535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-eb35394b-eb1a-4326-b8be-bad362d49e5d tempest-VolumeImageDependencyTests-740372535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eb35394b-eb1a-4326-b8be-bad362d49e5d tempest-VolumeImageDependencyTests-740372535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:20 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:20 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:20 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-305101e5-9b8d-4dbf-890c-f5334833f3a0" returned: 0 in 0.285s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.168s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1881554123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f4d7340ea4992849dbd7612dbdf9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:18Z,use_quota=True,user_id='d025070e283a4f1d86e05475952d27cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Creating volume b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:20 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e23e9bb-cb67-493b-903a-37e11968a125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-305101e5-9b8d-4dbf-890c-f5334833f3a0', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:20 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd 1073741824 Jul 24 09:54:20 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4c8cdc-c06f-491a-a90e-969e13a1eada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:20 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Volume volume-305101e5-9b8d-4dbf-890c-f5334833f3a0 (305101e5-9b8d-4dbf-890c-f5334833f3a0): created successfully Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4c8cdc-c06f-491a-a90e-969e13a1eada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Flow 'volume_create_manager' (a2f49c24-f287-4a44-82d0-77000d84fe77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:20 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-899ff36f-6698-4831-b8a9-dfba8e723604 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Created volume successfully. Jul 24 09:54:20 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f9dc43f5-8936-4242-a39a-83cf4b022ef5 tempest-CreateVolumesFromImageTest-305141596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2f1eb099-c67b-42f6-bc01-59aee1988028" returned: 0 in 0.349s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f9dc43f5-8936-4242-a39a-83cf4b022ef5 tempest-CreateVolumesFromImageTest-305141596 None] Lock "cinder-quobyte-2f1eb099-c67b-42f6-bc01-59aee1988028" released by "delete_volume" :: held 0.797s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ac2c42f6-8eab-4578-b2ff-f683e3ec2729 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Acquiring lock "cinder-a02998f0-1145-421d-81af-2f195c84f555-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:20 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-eb35394b-eb1a-4326-b8be-bad362d49e5d tempest-VolumeImageDependencyTests-740372535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.346s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-eb35394b-eb1a-4326-b8be-bad362d49e5d tempest-VolumeImageDependencyTests-740372535 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ac2c42f6-8eab-4578-b2ff-f683e3ec2729 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Lock "cinder-a02998f0-1145-421d-81af-2f195c84f555-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:20 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-eb35394b-eb1a-4326-b8be-bad362d49e5d tempest-VolumeImageDependencyTests-740372535 None] Deleted volume successfully. Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-eb35394b-eb1a-4326-b8be-bad362d49e5d tempest-VolumeImageDependencyTests-740372535 None] Lock "cinder-1fdaa0bc-55a0-4dc1-af1f-e73b20feb4f3-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ac2c42f6-8eab-4578-b2ff-f683e3ec2729 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Acquiring lock "cinder-quobyte-a02998f0-1145-421d-81af-2f195c84f555" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-f9dc43f5-8936-4242-a39a-83cf4b022ef5 tempest-CreateVolumesFromImageTest-305141596 None] Created reservations ['896326b6-a844-4091-beab-a6edcde9b52f', '460f10ec-d557-4f3a-ac93-79767931f53e', '1be5e2f4-41d1-45d8-8b2b-67b97de328d5', '08ec4b06-a61e-4e31-a494-e5c278f26b42'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ac2c42f6-8eab-4578-b2ff-f683e3ec2729 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Lock "cinder-quobyte-a02998f0-1145-421d-81af-2f195c84f555" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bb6ae5-258a-484f-9cbc-40e7cf210f5f]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ac2c42f6-8eab-4578-b2ff-f683e3ec2729 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a02998f0-1145-421d-81af-2f195c84f555 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f9dc43f5-8936-4242-a39a-83cf4b022ef5 tempest-CreateVolumesFromImageTest-305141596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f9dc43f5-8936-4242-a39a-83cf4b022ef5 tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f9dc43f5-8936-4242-a39a-83cf4b022ef5 tempest-CreateVolumesFromImageTest-305141596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f9dc43f5-8936-4242-a39a-83cf4b022ef5 tempest-CreateVolumesFromImageTest-305141596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f9dc43f5-8936-4242-a39a-83cf4b022ef5 tempest-CreateVolumesFromImageTest-305141596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f9dc43f5-8936-4242-a39a-83cf4b022ef5 tempest-CreateVolumesFromImageTest-305141596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:20 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:20 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:20 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a02998f0-1145-421d-81af-2f195c84f555 Jul 24 09:54:20 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:20 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f9dc43f5-8936-4242-a39a-83cf4b022ef5 tempest-CreateVolumesFromImageTest-305141596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.332s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-f9dc43f5-8936-4242-a39a-83cf4b022ef5 tempest-CreateVolumesFromImageTest-305141596 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:20 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-f9dc43f5-8936-4242-a39a-83cf4b022ef5 tempest-CreateVolumesFromImageTest-305141596 None] Deleted volume successfully. Jul 24 09:54:20 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd 1073741824" returned: 0 in 0.771s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f9dc43f5-8936-4242-a39a-83cf4b022ef5 tempest-CreateVolumesFromImageTest-305141596 None] Lock "cinder-2f1eb099-c67b-42f6-bc01-59aee1988028-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:21 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd Jul 24 09:54:21 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:21 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ac2c42f6-8eab-4578-b2ff-f683e3ec2729 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a02998f0-1145-421d-81af-2f195c84f555" returned: 0 in 0.512s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ac2c42f6-8eab-4578-b2ff-f683e3ec2729 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a02998f0-1145-421d-81af-2f195c84f555 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:21 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a02998f0-1145-421d-81af-2f195c84f555 Jul 24 09:54:21 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:21 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd" returned: 0 in 0.343s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67c3a77-cd29-4e6b-bfd6-4d5c66d5c1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5fb675-b395-4021-b199-cd21691ba544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:21 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ac2c42f6-8eab-4578-b2ff-f683e3ec2729 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a02998f0-1145-421d-81af-2f195c84f555" returned: 0 in 0.327s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ac2c42f6-8eab-4578-b2ff-f683e3ec2729 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Lock "cinder-quobyte-a02998f0-1145-421d-81af-2f195c84f555" released by "delete_volume" :: held 0.897s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:21 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Volume volume-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd (b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd): created successfully Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5fb675-b395-4021-b199-cd21691ba544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Flow 'volume_create_manager' (57605de9-8f69-424d-9eaa-27da11157394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:21 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-8f5f4745-f4dc-4029-82f5-1fa6ced9760e tempest-CreateVolumesFromSnapshotTest-1816288595 None] Created volume successfully. Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-ac2c42f6-8eab-4578-b2ff-f683e3ec2729 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Created reservations ['db8a6aa0-8b02-4228-af92-a21d5a4ab339', '9b3054a3-9750-4fc0-8c4a-931de740ed4e', '87105f3f-2b9f-43b5-9a06-1017b2e4213a', 'dee80933-0268-4bbd-80bf-edf975b97ed3'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ac2c42f6-8eab-4578-b2ff-f683e3ec2729 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ac2c42f6-8eab-4578-b2ff-f683e3ec2729 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ac2c42f6-8eab-4578-b2ff-f683e3ec2729 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ac2c42f6-8eab-4578-b2ff-f683e3ec2729 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ac2c42f6-8eab-4578-b2ff-f683e3ec2729 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ac2c42f6-8eab-4578-b2ff-f683e3ec2729 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:21 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:21 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:21 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ac2c42f6-8eab-4578-b2ff-f683e3ec2729 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.267s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-ac2c42f6-8eab-4578-b2ff-f683e3ec2729 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:21 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-ac2c42f6-8eab-4578-b2ff-f683e3ec2729 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Deleted volume successfully. Jul 24 09:54:21 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ac2c42f6-8eab-4578-b2ff-f683e3ec2729 tempest-VolumeAndVolumeTypeFromImageTest-9771036 None] Lock "cinder-a02998f0-1145-421d-81af-2f195c84f555-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:22 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3c00a810-e831-4c41-a794-ba648fe4a52b tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "cinder-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:22 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3c00a810-e831-4c41-a794-ba648fe4a52b tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:22 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3c00a810-e831-4c41-a794-ba648fe4a52b tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "cinder-quobyte-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:22 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3c00a810-e831-4c41-a794-ba648fe4a52b tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-quobyte-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:22 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d5be77-530d-4423-8a9d-c694b79d8fe9]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3c00a810-e831-4c41-a794-ba648fe4a52b tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:22 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd Jul 24 09:54:22 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:22 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3c00a810-e831-4c41-a794-ba648fe4a52b tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd" returned: 0 in 0.409s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3c00a810-e831-4c41-a794-ba648fe4a52b tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:22 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd Jul 24 09:54:22 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:23 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3c00a810-e831-4c41-a794-ba648fe4a52b tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd" returned: 0 in 0.303s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3c00a810-e831-4c41-a794-ba648fe4a52b tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-quobyte-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd" released by "delete_volume" :: held 0.767s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:23 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-3c00a810-e831-4c41-a794-ba648fe4a52b tempest-CreateVolumesFromSnapshotTest-1816288595 None] Created reservations ['e08ca890-bb3b-4604-8a98-6e42478f9a4c', '9adbc3f3-81b5-4d42-821a-78c4074a5e26', '99abe4c8-5ba1-46a2-8c8c-1eb9ad62c14d', '0db409c2-6790-4325-a5a4-8d2f8b95a605'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3c00a810-e831-4c41-a794-ba648fe4a52b tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3c00a810-e831-4c41-a794-ba648fe4a52b tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3c00a810-e831-4c41-a794-ba648fe4a52b tempest-CreateVolumesFromSnapshotTest-1816288595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-3c00a810-e831-4c41-a794-ba648fe4a52b tempest-CreateVolumesFromSnapshotTest-1816288595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-3c00a810-e831-4c41-a794-ba648fe4a52b tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3c00a810-e831-4c41-a794-ba648fe4a52b tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:23 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:23 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-53854bf2-872d-4e23-82c1-1d63c3a7efd0 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "cinder-305101e5-9b8d-4dbf-890c-f5334833f3a0-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-53854bf2-872d-4e23-82c1-1d63c3a7efd0 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-305101e5-9b8d-4dbf-890c-f5334833f3a0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-53854bf2-872d-4e23-82c1-1d63c3a7efd0 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "cinder-quobyte-305101e5-9b8d-4dbf-890c-f5334833f3a0" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-53854bf2-872d-4e23-82c1-1d63c3a7efd0 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-quobyte-305101e5-9b8d-4dbf-890c-f5334833f3a0" acquired by "delete_volume" :: waited 0.014s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:23 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dd90ca-1f65-4f84-a922-d33d60875d98]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-53854bf2-872d-4e23-82c1-1d63c3a7efd0 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-305101e5-9b8d-4dbf-890c-f5334833f3a0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:23 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-3c00a810-e831-4c41-a794-ba648fe4a52b tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.393s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:23 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-3c00a810-e831-4c41-a794-ba648fe4a52b tempest-CreateVolumesFromSnapshotTest-1816288595 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:23 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-3c00a810-e831-4c41-a794-ba648fe4a52b tempest-CreateVolumesFromSnapshotTest-1816288595 None] Deleted volume successfully. Jul 24 09:54:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-3c00a810-e831-4c41-a794-ba648fe4a52b tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-b1f4e7fa-87d1-4972-bfef-f1783f5c0cdd-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:23 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-305101e5-9b8d-4dbf-890c-f5334833f3a0 Jul 24 09:54:23 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:24 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-53854bf2-872d-4e23-82c1-1d63c3a7efd0 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-305101e5-9b8d-4dbf-890c-f5334833f3a0" returned: 0 in 0.416s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-53854bf2-872d-4e23-82c1-1d63c3a7efd0 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-305101e5-9b8d-4dbf-890c-f5334833f3a0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:24 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-305101e5-9b8d-4dbf-890c-f5334833f3a0 Jul 24 09:54:24 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:24 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-53854bf2-872d-4e23-82c1-1d63c3a7efd0 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-305101e5-9b8d-4dbf-890c-f5334833f3a0" returned: 0 in 0.310s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-53854bf2-872d-4e23-82c1-1d63c3a7efd0 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-quobyte-305101e5-9b8d-4dbf-890c-f5334833f3a0" released by "delete_volume" :: held 0.777s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-53854bf2-872d-4e23-82c1-1d63c3a7efd0 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Created reservations ['c18bb6da-05cf-47be-8e18-ad937195d624', 'ca18b553-5b61-4f74-9202-92286948bbf9', '3947a008-93d4-45d2-a58b-0d82227d24ca', '88c9908b-c1e7-4ff4-81aa-e10739c2f22c'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Flow 'volume_create_manager' (1b449e82-4806-4291-b7f3-4e7cc2dd2b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4677cd-cebc-4556-bcc1-45a170f2757c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4677cd-cebc-4556-bcc1-45a170f2757c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd58c5e6-b2df-4b30-b670-075d3f459e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c51912f643224758b6c97cdd260647ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:24Z,use_quota=True,user_id='c909d152e6384331b9b876e2e29c89c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d29791-c9ef-4b2c-8bda-37b8e8ff0d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d29791-c9ef-4b2c-8bda-37b8e8ff0d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84522dff-c7f6-4dbd-8b6a-2794f22e22ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84522dff-c7f6-4dbd-8b6a-2794f22e22ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd58c5e6-b2df-4b30-b670-075d3f459e64', 'volume_name': 'volume-bd58c5e6-b2df-4b30-b670-075d3f459e64', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37614494-9fec-48a9-ba25-6bfb8a96cb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37614494-9fec-48a9-ba25-6bfb8a96cb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf5c05d-8951-4a91-bed5-6727f85dadf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:24 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Volume bd58c5e6-b2df-4b30-b670-075d3f459e64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd58c5e6-b2df-4b30-b670-075d3f459e64', 'volume_size': 1} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd58c5e6-b2df-4b30-b670-075d3f459e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c51912f643224758b6c97cdd260647ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:24Z,use_quota=True,user_id='c909d152e6384331b9b876e2e29c89c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Creating volume bd58c5e6-b2df-4b30-b670-075d3f459e64 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:24 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd58c5e6-b2df-4b30-b670-075d3f459e64 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:24 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd58c5e6-b2df-4b30-b670-075d3f459e64 1073741824 Jul 24 09:54:24 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-53961c04-215f-441d-9498-b65758106143 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "cinder-87db6f36-9207-4e12-98c2-4206bd2171cf-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-53854bf2-872d-4e23-82c1-1d63c3a7efd0 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-53854bf2-872d-4e23-82c1-1d63c3a7efd0 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-53854bf2-872d-4e23-82c1-1d63c3a7efd0 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-53854bf2-872d-4e23-82c1-1d63c3a7efd0 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-53854bf2-872d-4e23-82c1-1d63c3a7efd0 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-53854bf2-872d-4e23-82c1-1d63c3a7efd0 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-53961c04-215f-441d-9498-b65758106143 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-87db6f36-9207-4e12-98c2-4206bd2171cf-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:24 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:24 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Flow 'volume_create_manager' (ad67cea4-7a99-407e-a32d-b479f1cf25f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efbf7be9-1cbe-4b08-947f-36e103893819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-53961c04-215f-441d-9498-b65758106143 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "cinder-quobyte-87db6f36-9207-4e12-98c2-4206bd2171cf" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efbf7be9-1cbe-4b08-947f-36e103893819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-238318947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13d955d-306c-44ef-b320-7c6aabd895ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e01ee476d35d48789877ccbe5daaaf66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:25Z,use_quota=True,user_id='69cdb72bfc1f42069f5afb2a24536252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a358b3-4deb-4ce0-b6dc-e07c9b69dcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a358b3-4deb-4ce0-b6dc-e07c9b69dcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ca6b1f-2edd-45c7-b283-f1cea6b2e035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ca6b1f-2edd-45c7-b283-f1cea6b2e035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f13d955d-306c-44ef-b320-7c6aabd895ba', 'volume_name': 'volume-f13d955d-306c-44ef-b320-7c6aabd895ba', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411df527-593a-411f-88a8-2aea1e0fcc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411df527-593a-411f-88a8-2aea1e0fcc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b8d0f4-d003-42b2-a59f-34a10d213469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:25 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Volume f13d955d-306c-44ef-b320-7c6aabd895ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f13d955d-306c-44ef-b320-7c6aabd895ba', 'volume_size': 1} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-53961c04-215f-441d-9498-b65758106143 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-quobyte-87db6f36-9207-4e12-98c2-4206bd2171cf" acquired by "delete_volume" :: waited 0.089s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f458ba36-3d26-4cb6-8cbf-e3bc0a87c37b]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-53961c04-215f-441d-9498-b65758106143 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87db6f36-9207-4e12-98c2-4206bd2171cf {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:25 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-53854bf2-872d-4e23-82c1-1d63c3a7efd0 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.371s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-53854bf2-872d-4e23-82c1-1d63c3a7efd0 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:25 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-53854bf2-872d-4e23-82c1-1d63c3a7efd0 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Deleted volume successfully. Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-53854bf2-872d-4e23-82c1-1d63c3a7efd0 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-305101e5-9b8d-4dbf-890c-f5334833f3a0-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:25 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87db6f36-9207-4e12-98c2-4206bd2171cf Jul 24 09:54:25 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:25 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd58c5e6-b2df-4b30-b670-075d3f459e64 1073741824" returned: 0 in 0.597s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd58c5e6-b2df-4b30-b670-075d3f459e64 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:25 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd58c5e6-b2df-4b30-b670-075d3f459e64 Jul 24 09:54:25 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:25 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-53961c04-215f-441d-9498-b65758106143 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87db6f36-9207-4e12-98c2-4206bd2171cf" returned: 0 in 0.438s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-53961c04-215f-441d-9498-b65758106143 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87db6f36-9207-4e12-98c2-4206bd2171cf {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:25 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87db6f36-9207-4e12-98c2-4206bd2171cf Jul 24 09:54:25 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:25 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd58c5e6-b2df-4b30-b670-075d3f459e64" returned: 0 in 0.291s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.585s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-238318947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13d955d-306c-44ef-b320-7c6aabd895ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e01ee476d35d48789877ccbe5daaaf66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:25Z,use_quota=True,user_id='69cdb72bfc1f42069f5afb2a24536252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Creating volume f13d955d-306c-44ef-b320-7c6aabd895ba {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:25 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:25 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba 1073741824 Jul 24 09:54:25 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf5c05d-8951-4a91-bed5-6727f85dadf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd58c5e6-b2df-4b30-b670-075d3f459e64', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47c8806-9462-488f-97a4-459d7121f9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:25 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Volume volume-bd58c5e6-b2df-4b30-b670-075d3f459e64 (bd58c5e6-b2df-4b30-b670-075d3f459e64): created successfully Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47c8806-9462-488f-97a4-459d7121f9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Flow 'volume_create_manager' (1b449e82-4806-4291-b7f3-4e7cc2dd2b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:25 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-316b0d20-1e5d-4c4f-bac7-99944e052c28 tempest-CinderUnicodeTest-2064461473 None] Created volume successfully. Jul 24 09:54:25 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-53961c04-215f-441d-9498-b65758106143 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87db6f36-9207-4e12-98c2-4206bd2171cf" returned: 0 in 0.333s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-53961c04-215f-441d-9498-b65758106143 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-quobyte-87db6f36-9207-4e12-98c2-4206bd2171cf" released by "delete_volume" :: held 0.833s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:25 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-53961c04-215f-441d-9498-b65758106143 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Created reservations ['4a3434cc-da6f-494d-9169-07e18a5c9a6e', 'df1fc514-9b0b-4ca7-a32a-0f25815470ee', '980488c2-c62a-4f26-8e95-1c0fa6f2c89d', '82fb23e3-de44-49b7-9ddb-d2bab8552609'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-53961c04-215f-441d-9498-b65758106143 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-53961c04-215f-441d-9498-b65758106143 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-53961c04-215f-441d-9498-b65758106143 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-53961c04-215f-441d-9498-b65758106143 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-53961c04-215f-441d-9498-b65758106143 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-53961c04-215f-441d-9498-b65758106143 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:26 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:26 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:26 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba 1073741824" returned: 0 in 0.642s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:26 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba Jul 24 09:54:26 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:26 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-53961c04-215f-441d-9498-b65758106143 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.318s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:26 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-53961c04-215f-441d-9498-b65758106143 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:26 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-53961c04-215f-441d-9498-b65758106143 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Deleted volume successfully. Jul 24 09:54:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-53961c04-215f-441d-9498-b65758106143 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-87db6f36-9207-4e12-98c2-4206bd2171cf-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:26 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba" returned: 0 in 0.308s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:26 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b8d0f4-d003-42b2-a59f-34a10d213469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13d955d-306c-44ef-b320-7c6aabd895ba', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292f0a68-ac8b-49c5-b664-4809c47ee268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:26 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Volume volume-f13d955d-306c-44ef-b320-7c6aabd895ba (f13d955d-306c-44ef-b320-7c6aabd895ba): created successfully Jul 24 09:54:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292f0a68-ac8b-49c5-b664-4809c47ee268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:26 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Flow 'volume_create_manager' (ad67cea4-7a99-407e-a32d-b479f1cf25f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:26 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-cf2e9304-793f-421e-9218-50a1ff14f9ee tempest-VolumeDependencyTests-1939256379 None] Created volume successfully. Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cb8ac10c-43c6-4de1-a627-a34c32db9146 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "cinder-96867cda-142e-444b-aeb9-32174b584681-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cb8ac10c-43c6-4de1-a627-a34c32db9146 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-96867cda-142e-444b-aeb9-32174b584681-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cb8ac10c-43c6-4de1-a627-a34c32db9146 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "cinder-quobyte-96867cda-142e-444b-aeb9-32174b584681" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cb8ac10c-43c6-4de1-a627-a34c32db9146 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-quobyte-96867cda-142e-444b-aeb9-32174b584681" acquired by "delete_volume" :: waited 0.023s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e95044-a6f2-405e-9607-9de1abadaff0]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cb8ac10c-43c6-4de1-a627-a34c32db9146 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96867cda-142e-444b-aeb9-32174b584681 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Flow 'volume_create_manager' (298de969-a324-4f5a-906c-bbf5f7e618a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1bf856-810e-4bd5-a7f8-112de80ef810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1bf856-810e-4bd5-a7f8-112de80ef810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1996717966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3268507-0ead-4e96-a0b2-7bd48d7b18c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c51912f643224758b6c97cdd260647ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:27Z,use_quota=True,user_id='c909d152e6384331b9b876e2e29c89c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab40f7f9-47f5-44f5-80cc-284c4a77393a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab40f7f9-47f5-44f5-80cc-284c4a77393a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87ff12f-4766-4649-88b7-d455b59890d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87ff12f-4766-4649-88b7-d455b59890d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3268507-0ead-4e96-a0b2-7bd48d7b18c0', 'volume_name': 'volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5890389c-5d58-462b-8503-2dd54a51897a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5890389c-5d58-462b-8503-2dd54a51897a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:27 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96867cda-142e-444b-aeb9-32174b584681 Jul 24 09:54:27 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c5f601-95b2-40b5-91b9-ac9f4cc81d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:27 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Volume d3268507-0ead-4e96-a0b2-7bd48d7b18c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0', 'volume_size': 1} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1996717966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3268507-0ead-4e96-a0b2-7bd48d7b18c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c51912f643224758b6c97cdd260647ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:27Z,use_quota=True,user_id='c909d152e6384331b9b876e2e29c89c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Creating volume d3268507-0ead-4e96-a0b2-7bd48d7b18c0 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:27 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-581a1073-7aa0-4aef-9196-dbf301ecd04b tempest-VolumeDependencyTests-1939256379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:27 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0 1073741824 Jul 24 09:54:27 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:27 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cb8ac10c-43c6-4de1-a627-a34c32db9146 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96867cda-142e-444b-aeb9-32174b584681" returned: 0 in 0.398s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cb8ac10c-43c6-4de1-a627-a34c32db9146 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96867cda-142e-444b-aeb9-32174b584681 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:27 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96867cda-142e-444b-aeb9-32174b584681 Jul 24 09:54:27 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:27 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0 1073741824" returned: 0 in 0.462s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:27 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cb8ac10c-43c6-4de1-a627-a34c32db9146 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-96867cda-142e-444b-aeb9-32174b584681" returned: 0 in 0.270s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:27 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0 Jul 24 09:54:27 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cb8ac10c-43c6-4de1-a627-a34c32db9146 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-quobyte-96867cda-142e-444b-aeb9-32174b584681" released by "delete_volume" :: held 0.717s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-cb8ac10c-43c6-4de1-a627-a34c32db9146 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Created reservations ['58b2b139-fdfc-4646-8de4-abe35e8c9691', 'aab9a188-a73a-446a-8eca-590d43ecbc1c', 'bb285b8a-1afb-4963-a4e3-980918e848b8', '4a37a62a-6328-4c14-bd19-9a40a6a8a7f0'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cb8ac10c-43c6-4de1-a627-a34c32db9146 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cb8ac10c-43c6-4de1-a627-a34c32db9146 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cb8ac10c-43c6-4de1-a627-a34c32db9146 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cb8ac10c-43c6-4de1-a627-a34c32db9146 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cb8ac10c-43c6-4de1-a627-a34c32db9146 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cb8ac10c-43c6-4de1-a627-a34c32db9146 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:28 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:28 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:28 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0" returned: 0 in 0.301s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-581a1073-7aa0-4aef-9196-dbf301ecd04b tempest-VolumeDependencyTests-1939256379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.805s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c5f601-95b2-40b5-91b9-ac9f4cc81d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52782050-459f-4da5-a74c-a2323632df42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-581a1073-7aa0-4aef-9196-dbf301ecd04b tempest-VolumeDependencyTests-1939256379 None] Creating offline snapshot 69ec5678-60aa-45be-8109-95b52c694d3f of volume f13d955d-306c-44ef-b320-7c6aabd895ba {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:54:28 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Volume volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0 (d3268507-0ead-4e96-a0b2-7bd48d7b18c0): created successfully Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52782050-459f-4da5-a74c-a2323632df42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Flow 'volume_create_manager' (298de969-a324-4f5a-906c-bbf5f7e618a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fc6c77-2214-4ffe-b195-b4dea6a26ba9]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-581a1073-7aa0-4aef-9196-dbf301ecd04b tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e52cc13-c952-47f6-9553-9baa0f514d88 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "cinder-1ffce1ef-0118-42b9-8bd9-710ce8c25e61-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:28 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b7b9c95b-d9d9-4d75-9c99-e0b51c8963a9 tempest-CinderUnicodeTest-2064461473 None] Created volume successfully. Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e52cc13-c952-47f6-9553-9baa0f514d88 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-1ffce1ef-0118-42b9-8bd9-710ce8c25e61-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e52cc13-c952-47f6-9553-9baa0f514d88 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "cinder-quobyte-1ffce1ef-0118-42b9-8bd9-710ce8c25e61" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e52cc13-c952-47f6-9553-9baa0f514d88 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-quobyte-1ffce1ef-0118-42b9-8bd9-710ce8c25e61" acquired by "delete_volume" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:28 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cb8ac10c-43c6-4de1-a627-a34c32db9146 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.362s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-cb8ac10c-43c6-4de1-a627-a34c32db9146 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:28 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-cb8ac10c-43c6-4de1-a627-a34c32db9146 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Deleted volume successfully. Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad9335e-f101-4c19-b08c-959518b3d2c6]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e52cc13-c952-47f6-9553-9baa0f514d88 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ffce1ef-0118-42b9-8bd9-710ce8c25e61 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cb8ac10c-43c6-4de1-a627-a34c32db9146 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-96867cda-142e-444b-aeb9-32174b584681-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:28 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba Jul 24 09:54:28 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:28 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ffce1ef-0118-42b9-8bd9-710ce8c25e61 Jul 24 09:54:28 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Flow 'volume_create_manager' (8e0dcda5-b8af-495c-a636-df5a7e94bd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65324ffd-97e2-4343-928d-67bb59fa2ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65324ffd-97e2-4343-928d-67bb59fa2ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-966958649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df379013-aa73-4ef6-a735-cfbe8341854e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579627f9f2774cdb91d2fbffae9e0f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:29Z,use_quota=True,user_id='a31483838e72474abfb6936e91784cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a371aa2-9cf5-4dab-a6c4-38fbf73a685e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a371aa2-9cf5-4dab-a6c4-38fbf73a685e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:28 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5529692f-61c1-4e69-a71a-fe195cad4c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5529692f-61c1-4e69-a71a-fe195cad4c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df379013-aa73-4ef6-a735-cfbe8341854e', 'volume_name': 'volume-df379013-aa73-4ef6-a735-cfbe8341854e', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426e0780-22ca-45f8-b10a-8a7c85b6565e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426e0780-22ca-45f8-b10a-8a7c85b6565e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70325aee-a219-49aa-b438-28a27aa88374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:28 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Volume df379013-aa73-4ef6-a735-cfbe8341854e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df379013-aa73-4ef6-a735-cfbe8341854e', 'volume_size': 1} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-581a1073-7aa0-4aef-9196-dbf301ecd04b tempest-VolumeDependencyTests-1939256379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba" returned: 0 in 0.496s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-581a1073-7aa0-4aef-9196-dbf301ecd04b tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:28 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f 1G Jul 24 09:54:28 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:28 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e52cc13-c952-47f6-9553-9baa0f514d88 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ffce1ef-0118-42b9-8bd9-710ce8c25e61" returned: 0 in 0.398s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e52cc13-c952-47f6-9553-9baa0f514d88 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ffce1ef-0118-42b9-8bd9-710ce8c25e61 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:28 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ffce1ef-0118-42b9-8bd9-710ce8c25e61 Jul 24 09:54:28 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:29 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e52cc13-c952-47f6-9553-9baa0f514d88 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ffce1ef-0118-42b9-8bd9-710ce8c25e61" returned: 0 in 0.249s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e52cc13-c952-47f6-9553-9baa0f514d88 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-quobyte-1ffce1ef-0118-42b9-8bd9-710ce8c25e61" released by "delete_volume" :: held 0.692s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-4e52cc13-c952-47f6-9553-9baa0f514d88 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Created reservations ['069e4c5a-3e16-451b-947d-8855f447adac', '19b0ed96-34eb-4fba-b85a-3402707af337', '366bcdc4-c069-44d3-9349-1f3129391ea6', '046f7d5f-55d1-467f-882a-b27a8a6b557d'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:29 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-581a1073-7aa0-4aef-9196-dbf301ecd04b tempest-VolumeDependencyTests-1939256379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f 1G" returned: 0 in 0.410s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-581a1073-7aa0-4aef-9196-dbf301ecd04b tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f13d955d-306c-44ef-b320-7c6aabd895ba -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:29 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f13d955d-306c-44ef-b320-7c6aabd895ba -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f Jul 24 09:54:29 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4e52cc13-c952-47f6-9553-9baa0f514d88 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4e52cc13-c952-47f6-9553-9baa0f514d88 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4e52cc13-c952-47f6-9553-9baa0f514d88 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4e52cc13-c952-47f6-9553-9baa0f514d88 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4e52cc13-c952-47f6-9553-9baa0f514d88 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e52cc13-c952-47f6-9553-9baa0f514d88 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:29 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:29 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "cinder-1e027aca-f32f-4fe5-af6c-d66f976e6d5b-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-1e027aca-f32f-4fe5-af6c-d66f976e6d5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "cinder-quobyte-771aa255-1551-4d5b-bfe7-33b25f6dbcb2" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:29 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-quobyte-771aa255-1551-4d5b-bfe7-33b25f6dbcb2" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "cinder-quobyte-1e027aca-f32f-4fe5-af6c-d66f976e6d5b" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0e53ad89-3dda-47c0-b331-bb9d043b12d2 tempest-CinderUnicodeTest-2064461473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-581a1073-7aa0-4aef-9196-dbf301ecd04b tempest-VolumeDependencyTests-1939256379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f13d955d-306c-44ef-b320-7c6aabd895ba -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f" returned: 0 in 0.377s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:29 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-581a1073-7aa0-4aef-9196-dbf301ecd04b tempest-VolumeDependencyTests-1939256379 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f is being set with open permissions: ugo+rw Jul 24 09:54:29 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-581a1073-7aa0-4aef-9196-dbf301ecd04b tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4e52cc13-c952-47f6-9553-9baa0f514d88 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.339s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-4e52cc13-c952-47f6-9553-9baa0f514d88 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:29 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-quobyte-1e027aca-f32f-4fe5-af6c-d66f976e6d5b" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:29 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Deleting offline snapshot 1e027aca-f32f-4fe5-af6c-d66f976e6d5b of volume 771aa255-1551-4d5b-bfe7-33b25f6dbcb2 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] snapshot_file for this snap is: volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.1e027aca-f32f-4fe5-af6c-d66f976e6d5b {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:54:29 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-4e52cc13-c952-47f6-9553-9baa0f514d88 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Deleted volume successfully. Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[721dc0c6-3ded-4365-93ab-fe29c83574a1]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.1e027aca-f32f-4fe5-af6c-d66f976e6d5b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-4e52cc13-c952-47f6-9553-9baa0f514d88 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-1ffce1ef-0118-42b9-8bd9-710ce8c25e61-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:29 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.1e027aca-f32f-4fe5-af6c-d66f976e6d5b Jul 24 09:54:29 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:29 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-581a1073-7aa0-4aef-9196-dbf301ecd04b tempest-VolumeDependencyTests-1939256379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f" returned: 0 in 0.247s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-581a1073-7aa0-4aef-9196-dbf301ecd04b tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:29 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.info Jul 24 09:54:29 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:30 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.1e027aca-f32f-4fe5-af6c-d66f976e6d5b" returned: 0 in 0.365s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bef541-018b-4729-a1f1-10586b00af26]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:30 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-581a1073-7aa0-4aef-9196-dbf301ecd04b tempest-VolumeDependencyTests-1939256379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.info" returned: 0 in 0.259s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:30 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-581a1073-7aa0-4aef-9196-dbf301ecd04b tempest-VolumeDependencyTests-1939256379 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.info is being set with open permissions: ugo+rw Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-581a1073-7aa0-4aef-9196-dbf301ecd04b tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:30 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.info Jul 24 09:54:30 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2 Jul 24 09:54:30 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:30 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:30 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-581a1073-7aa0-4aef-9196-dbf301ecd04b tempest-VolumeDependencyTests-1939256379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.info" returned: 0 in 0.253s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-581a1073-7aa0-4aef-9196-dbf301ecd04b tempest-VolumeDependencyTests-1939256379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.194s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.610s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-966958649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df379013-aa73-4ef6-a735-cfbe8341854e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579627f9f2774cdb91d2fbffae9e0f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:29Z,use_quota=True,user_id='a31483838e72474abfb6936e91784cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Creating volume df379013-aa73-4ef6-a735-cfbe8341854e {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:30 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df379013-aa73-4ef6-a735-cfbe8341854e 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:30 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2" returned: 0 in 0.385s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.1e027aca-f32f-4fe5-af6c-d66f976e6d5b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:30 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df379013-aa73-4ef6-a735-cfbe8341854e 1073741824 Jul 24 09:54:30 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:30 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.1e027aca-f32f-4fe5-af6c-d66f976e6d5b Jul 24 09:54:30 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:30 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-581a1073-7aa0-4aef-9196-dbf301ecd04b tempest-VolumeDependencyTests-1939256379 None] Create snapshot completed successfully Jul 24 09:54:30 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.1e027aca-f32f-4fe5-af6c-d66f976e6d5b" returned: 0 in 0.357s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.1e027aca-f32f-4fe5-af6c-d66f976e6d5b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:30 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.1e027aca-f32f-4fe5-af6c-d66f976e6d5b Jul 24 09:54:30 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:30 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df379013-aa73-4ef6-a735-cfbe8341854e 1073741824" returned: 0 in 0.425s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df379013-aa73-4ef6-a735-cfbe8341854e {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:30 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df379013-aa73-4ef6-a735-cfbe8341854e Jul 24 09:54:30 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:31 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2.1e027aca-f32f-4fe5-af6c-d66f976e6d5b" returned: 0 in 0.255s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-quobyte-1e027aca-f32f-4fe5-af6c-d66f976e6d5b" released by "_delete_snapshot" :: held 1.463s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-quobyte-771aa255-1551-4d5b-bfe7-33b25f6dbcb2" released by "delete_snapshot" :: held 1.507s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:31 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df379013-aa73-4ef6-a735-cfbe8341854e" returned: 0 in 0.246s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0e53ad89-3dda-47c0-b331-bb9d043b12d2 tempest-CinderUnicodeTest-2064461473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.536s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70325aee-a219-49aa-b438-28a27aa88374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df379013-aa73-4ef6-a735-cfbe8341854e', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d82ba64-23db-46b8-b311-22de2bcaf746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-0e53ad89-3dda-47c0-b331-bb9d043b12d2 tempest-CinderUnicodeTest-2064461473 None] Creating offline snapshot bb286dc2-573d-4b69-bf22-19165eb5df4f of volume d3268507-0ead-4e96-a0b2-7bd48d7b18c0 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:54:31 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Volume volume-df379013-aa73-4ef6-a735-cfbe8341854e (df379013-aa73-4ef6-a735-cfbe8341854e): created successfully Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d82ba64-23db-46b8-b311-22de2bcaf746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Flow 'volume_create_manager' (8e0dcda5-b8af-495c-a636-df5a7e94bd01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2381b432-89e4-4600-8430-65a1fe5c3688]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0e53ad89-3dda-47c0-b331-bb9d043b12d2 tempest-CinderUnicodeTest-2064461473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:31 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-df013e64-d18b-4b85-8691-715b647b82ca tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Created volume successfully. Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Created reservations ['c9ceb0db-a115-4830-8da8-afeb8df10285', '64adea7d-c0ad-4b93-9bdb-d0faa9e30ef1', '4c3ea1e6-9c91-4f62-80e2-eb83b00bcff8', '92893776-4605-49c3-89f6-27fc8cfc7a8e'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:31 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0 Jul 24 09:54:31 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:31 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Delete snapshot completed successfully. Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c3eb9d6e-79c8-4da2-b06e-b2501d5befb9 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-1e027aca-f32f-4fe5-af6c-d66f976e6d5b-delete_snapshot" released by "delete_snapshot" :: held 1.832s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:31 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0e53ad89-3dda-47c0-b331-bb9d043b12d2 tempest-CinderUnicodeTest-2064461473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0" returned: 0 in 0.404s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0e53ad89-3dda-47c0-b331-bb9d043b12d2 tempest-CinderUnicodeTest-2064461473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.bb286dc2-573d-4b69-bf22-19165eb5df4f 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:31 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.bb286dc2-573d-4b69-bf22-19165eb5df4f 1G Jul 24 09:54:31 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-02628aab-1af3-4bc7-b4f0-37ee1b850244 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "cinder-771aa255-1551-4d5b-bfe7-33b25f6dbcb2-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-02628aab-1af3-4bc7-b4f0-37ee1b850244 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-771aa255-1551-4d5b-bfe7-33b25f6dbcb2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-02628aab-1af3-4bc7-b4f0-37ee1b850244 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "cinder-quobyte-771aa255-1551-4d5b-bfe7-33b25f6dbcb2" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-02628aab-1af3-4bc7-b4f0-37ee1b850244 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-quobyte-771aa255-1551-4d5b-bfe7-33b25f6dbcb2" acquired by "delete_volume" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1618beb5-e363-45a7-bf0e-e986b7fb443a]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-02628aab-1af3-4bc7-b4f0-37ee1b850244 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:31 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Flow 'volume_create_manager' (6566888d-9f03-4234-96c6-748b0de44eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915c06da-a60a-4720-a489-025fe8fc7acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915c06da-a60a-4720-a489-025fe8fc7acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1957043255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c701d19f-6732-4a92-ba3a-95d7b9d70378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e01ee476d35d48789877ccbe5daaaf66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=69ec5678-60aa-45be-8109-95b52c694d3f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:32Z,use_quota=True,user_id='69cdb72bfc1f42069f5afb2a24536252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f207a63b-8d0a-42c5-9bca-3cd06ae6769a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f207a63b-8d0a-42c5-9bca-3cd06ae6769a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ad3fc9-1c8c-448b-9df1-0cc9df7d8de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ad3fc9-1c8c-448b-9df1-0cc9df7d8de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c701d19f-6732-4a92-ba3a-95d7b9d70378', 'volume_name': 'volume-c701d19f-6732-4a92-ba3a-95d7b9d70378', 'volume_size': 1, 'snapshot_id': '69ec5678-60aa-45be-8109-95b52c694d3f'}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c82788-2fe4-4fd9-a2d5-79758b7b776d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c82788-2fe4-4fd9-a2d5-79758b7b776d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:32 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2 Jul 24 09:54:32 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00659cf2-f749-41aa-80b2-7b0316e8ea6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:32 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Volume c701d19f-6732-4a92-ba3a-95d7b9d70378: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c701d19f-6732-4a92-ba3a-95d7b9d70378', 'volume_size': 1, 'snapshot_id': '69ec5678-60aa-45be-8109-95b52c694d3f'} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:32 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0e53ad89-3dda-47c0-b331-bb9d043b12d2 tempest-CinderUnicodeTest-2064461473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.bb286dc2-573d-4b69-bf22-19165eb5df4f 1G" returned: 0 in 0.561s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0e53ad89-3dda-47c0-b331-bb9d043b12d2 tempest-CinderUnicodeTest-2064461473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.bb286dc2-573d-4b69-bf22-19165eb5df4f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:32 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.bb286dc2-573d-4b69-bf22-19165eb5df4f Jul 24 09:54:32 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:32 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-02628aab-1af3-4bc7-b4f0-37ee1b850244 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2" returned: 0 in 0.428s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-02628aab-1af3-4bc7-b4f0-37ee1b850244 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:32 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2 Jul 24 09:54:32 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Flow 'volume_create_manager' (82063b41-8b94-4d3b-9fab-bb27a26419ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f326c4f-eddd-4547-b7d1-8cf0a6eb4e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f326c4f-eddd-4547-b7d1-8cf0a6eb4e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2064598286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d2e236-46e5-4885-886b-43afc332419b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579627f9f2774cdb91d2fbffae9e0f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:32Z,use_quota=True,user_id='a31483838e72474abfb6936e91784cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:32 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2e79e6-05be-44d1-b83c-14859565a7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2e79e6-05be-44d1-b83c-14859565a7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0726bc9-dee5-4a9d-8163-2b9cfa7bf447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0726bc9-dee5-4a9d-8163-2b9cfa7bf447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29d2e236-46e5-4885-886b-43afc332419b', 'volume_name': 'volume-29d2e236-46e5-4885-886b-43afc332419b', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72af9a5-499f-406a-97ec-9df65c726551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72af9a5-499f-406a-97ec-9df65c726551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a5f37e-a88c-45a0-8e82-74a7d1446f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:32 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Volume 29d2e236-46e5-4885-886b-43afc332419b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29d2e236-46e5-4885-886b-43afc332419b', 'volume_size': 1} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0e53ad89-3dda-47c0-b331-bb9d043b12d2 tempest-CinderUnicodeTest-2064461473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.bb286dc2-573d-4b69-bf22-19165eb5df4f" returned: 0 in 0.433s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:32 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-0e53ad89-3dda-47c0-b331-bb9d043b12d2 tempest-CinderUnicodeTest-2064461473 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.bb286dc2-573d-4b69-bf22-19165eb5df4f is being set with open permissions: ugo+rw Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0e53ad89-3dda-47c0-b331-bb9d043b12d2 tempest-CinderUnicodeTest-2064461473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.bb286dc2-573d-4b69-bf22-19165eb5df4f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:32 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.bb286dc2-573d-4b69-bf22-19165eb5df4f Jul 24 09:54:32 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:32 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-02628aab-1af3-4bc7-b4f0-37ee1b850244 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-771aa255-1551-4d5b-bfe7-33b25f6dbcb2" returned: 0 in 0.286s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-02628aab-1af3-4bc7-b4f0-37ee1b850244 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-quobyte-771aa255-1551-4d5b-bfe7-33b25f6dbcb2" released by "delete_volume" :: held 0.808s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-02628aab-1af3-4bc7-b4f0-37ee1b850244 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Created reservations ['b6755777-2adc-47ab-86d7-8139bfcf0a6e', 'd5bc22a4-3b68-4864-ae5d-a01b9cd03065', 'c9d1f2cf-95bc-4b34-bf91-aed536cc4887', '98b5e213-6146-4816-b030-137a2014856a'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-02628aab-1af3-4bc7-b4f0-37ee1b850244 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-02628aab-1af3-4bc7-b4f0-37ee1b850244 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-02628aab-1af3-4bc7-b4f0-37ee1b850244 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-02628aab-1af3-4bc7-b4f0-37ee1b850244 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-02628aab-1af3-4bc7-b4f0-37ee1b850244 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-02628aab-1af3-4bc7-b4f0-37ee1b850244 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:32 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:32 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:32 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0e53ad89-3dda-47c0-b331-bb9d043b12d2 tempest-CinderUnicodeTest-2064461473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.bb286dc2-573d-4b69-bf22-19165eb5df4f" returned: 0 in 0.354s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0e53ad89-3dda-47c0-b331-bb9d043b12d2 tempest-CinderUnicodeTest-2064461473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:33 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.info Jul 24 09:54:33 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Flow 'volume_create_manager' (3d0dadbb-004f-4844-9603-1cab1c69d762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6899d951-7a20-4706-9342-d37708481d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6899d951-7a20-4706-9342-d37708481d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-737732439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32eb6f23-d3da-4da0-a2cd-a687bf970d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579627f9f2774cdb91d2fbffae9e0f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:33Z,use_quota=True,user_id='a31483838e72474abfb6936e91784cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf59795-ae5c-4539-b639-3621b49b1fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf59795-ae5c-4539-b639-3621b49b1fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8154ef8-8a1e-4d07-ad0a-57eba68fefb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8154ef8-8a1e-4d07-ad0a-57eba68fefb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32eb6f23-d3da-4da0-a2cd-a687bf970d10', 'volume_name': 'volume-32eb6f23-d3da-4da0-a2cd-a687bf970d10', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:33 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054dc605-855e-410a-8d19-865813b7add4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054dc605-855e-410a-8d19-865813b7add4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e8ab6d-0668-4d29-a3bd-bb2c1269e874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:33 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Volume 32eb6f23-d3da-4da0-a2cd-a687bf970d10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32eb6f23-d3da-4da0-a2cd-a687bf970d10', 'volume_size': 1} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-02628aab-1af3-4bc7-b4f0-37ee1b850244 tempest-CreateVolumesFromSnapshotTest-1816288595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.386s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-02628aab-1af3-4bc7-b4f0-37ee1b850244 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:33 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-02628aab-1af3-4bc7-b4f0-37ee1b850244 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Deleted volume successfully. Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-02628aab-1af3-4bc7-b4f0-37ee1b850244 tempest-CreateVolumesFromSnapshotTest-1816288595 None] Lock "cinder-771aa255-1551-4d5b-bfe7-33b25f6dbcb2-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:33 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0e53ad89-3dda-47c0-b331-bb9d043b12d2 tempest-CinderUnicodeTest-2064461473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.info" returned: 0 in 0.353s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:33 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-0e53ad89-3dda-47c0-b331-bb9d043b12d2 tempest-CinderUnicodeTest-2064461473 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.info is being set with open permissions: ugo+rw Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0e53ad89-3dda-47c0-b331-bb9d043b12d2 tempest-CinderUnicodeTest-2064461473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:33 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.info Jul 24 09:54:33 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Flow 'volume_create_manager' (3d98382e-e9ee-4cce-8a54-fb6b4978e121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0ae811-1d2d-4aa0-aea0-ab5ead18d8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0ae811-1d2d-4aa0-aea0-ab5ead18d8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1030946039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6dc88e3-0929-4f8e-926a-1c72f002d508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579627f9f2774cdb91d2fbffae9e0f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:33Z,use_quota=True,user_id='a31483838e72474abfb6936e91784cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fa7658-b55a-4c2e-8d72-9c35c8849ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fa7658-b55a-4c2e-8d72-9c35c8849ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b53bc0-e237-44df-8c46-28246e4a93a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b53bc0-e237-44df-8c46-28246e4a93a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6dc88e3-0929-4f8e-926a-1c72f002d508', 'volume_name': 'volume-d6dc88e3-0929-4f8e-926a-1c72f002d508', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88d46fb-af14-4234-93b3-31b57a5a23cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88d46fb-af14-4234-93b3-31b57a5a23cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3654a4f3-7898-4781-a081-28495942e9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:33 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Volume d6dc88e3-0929-4f8e-926a-1c72f002d508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6dc88e3-0929-4f8e-926a-1c72f002d508', 'volume_size': 1} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:33 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0e53ad89-3dda-47c0-b331-bb9d043b12d2 tempest-CinderUnicodeTest-2064461473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.info" returned: 0 in 0.389s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0e53ad89-3dda-47c0-b331-bb9d043b12d2 tempest-CinderUnicodeTest-2064461473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.631s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.692s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Acquiring lock "cinder-quobyte-69ec5678-60aa-45be-8109-95b52c694d3f-c701d19f-6732-4a92-ba3a-95d7b9d70378" by "_create_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Lock "cinder-quobyte-69ec5678-60aa-45be-8109-95b52c694d3f-c701d19f-6732-4a92-ba3a-95d7b9d70378" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Creating volume c701d19f-6732-4a92-ba3a-95d7b9d70378 from snapshot 69ec5678-60aa-45be-8109-95b52c694d3f {{(pid=88488) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Acquiring lock "cinder-quobyte-c701d19f-6732-4a92-ba3a-95d7b9d70378" by "_copy_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:33 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-0e53ad89-3dda-47c0-b331-bb9d043b12d2 tempest-CinderUnicodeTest-2064461473 None] Create snapshot completed successfully Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Lock "cinder-quobyte-c701d19f-6732-4a92-ba3a-95d7b9d70378" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] snapshot: 69ec5678-60aa-45be-8109-95b52c694d3f, volume: c701d19f-6732-4a92-ba3a-95d7b9d70378, {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Flow 'volume_create_manager' (069dc377-4005-42a2-98e9-c65387d9d392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6458d8b2-bdb0-48ce-9916-f74f947f0e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6458d8b2-bdb0-48ce-9916-f74f947f0e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-753112483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd792126-a011-4056-8a14-888369ed086d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579627f9f2774cdb91d2fbffae9e0f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:34Z,use_quota=True,user_id='a31483838e72474abfb6936e91784cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd80caa-5485-44c9-8577-c77eda362c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd80caa-5485-44c9-8577-c77eda362c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31e6bf35-baf3-4d74-ba46-3c623dcedb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31e6bf35-baf3-4d74-ba46-3c623dcedb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd792126-a011-4056-8a14-888369ed086d', 'volume_name': 'volume-bd792126-a011-4056-8a14-888369ed086d', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9a34b0-69fb-48d4-a13f-87089852a77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9a34b0-69fb-48d4-a13f-87089852a77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61c51a8-0296-4f03-9ad5-5a52b8073842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:34 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Volume bd792126-a011-4056-8a14-888369ed086d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd792126-a011-4056-8a14-888369ed086d', 'volume_size': 1} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e5cf11-7d52-424b-8bf4-7542c247b120]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:34 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f Jul 24 09:54:34 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Flow 'volume_create_manager' (7e79593c-5d3a-4a2d-92bb-f8aafcdcca07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a70fa37-69bc-48e0-8be6-3c76af908d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a70fa37-69bc-48e0-8be6-3c76af908d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1629401676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=849ba4e1-4f8a-419b-a3a1-a65b8161e4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579627f9f2774cdb91d2fbffae9e0f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:34Z,use_quota=True,user_id='a31483838e72474abfb6936e91784cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e14ed2-5e1c-4ee4-ad3f-d85bb27cf831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e14ed2-5e1c-4ee4-ad3f-d85bb27cf831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f109fcf0-3c86-463e-a6f3-b8312057d0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f109fcf0-3c86-463e-a6f3-b8312057d0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '849ba4e1-4f8a-419b-a3a1-a65b8161e4fd', 'volume_name': 'volume-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc9f7f2-ba07-45e5-afcd-9407dec7d222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc9f7f2-ba07-45e5-afcd-9407dec7d222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8a4188-f36d-486d-b8ef-b72269bdbcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:34 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Volume 849ba4e1-4f8a-419b-a3a1-a65b8161e4fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd', 'volume_size': 1} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:34 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f" returned: 0 in 0.378s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f13d955d-306c-44ef-b320-7c6aabd895ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Creating direct copy from snapshot {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4254ca9-b12d-4382-8430-e8ed64e24088]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:34 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba Jul 24 09:54:34 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:34 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba" returned: 0 in 0.393s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.utils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Path /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c701d19f-6732-4a92-ba3a-95d7b9d70378 not found in is_blk_device check {{(pid=88488) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c701d19f-6732-4a92-ba3a-95d7b9d70378 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] Acquiring lock "cinder-bb286dc2-573d-4b69-bf22-19165eb5df4f-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:34 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c701d19f-6732-4a92-ba3a-95d7b9d70378 Jul 24 09:54:34 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] Lock "cinder-bb286dc2-573d-4b69-bf22-19165eb5df4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] Acquiring lock "cinder-quobyte-d3268507-0ead-4e96-a0b2-7bd48d7b18c0" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] Lock "cinder-quobyte-d3268507-0ead-4e96-a0b2-7bd48d7b18c0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] Acquiring lock "cinder-quobyte-bb286dc2-573d-4b69-bf22-19165eb5df4f" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] Lock "cinder-quobyte-bb286dc2-573d-4b69-bf22-19165eb5df4f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] Deleting offline snapshot bb286dc2-573d-4b69-bf22-19165eb5df4f of volume d3268507-0ead-4e96-a0b2-7bd48d7b18c0 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] snapshot_file for this snap is: volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.bb286dc2-573d-4b69-bf22-19165eb5df4f {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a0134b-1b14-402e-b84b-9d809bd38b31]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.bb286dc2-573d-4b69-bf22-19165eb5df4f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:35 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.bb286dc2-573d-4b69-bf22-19165eb5df4f Jul 24 09:54:35 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:35 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.bb286dc2-573d-4b69-bf22-19165eb5df4f" returned: 0 in 0.461s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:35 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:54:35 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd42851c-b3a1-45d7-95d8-3f0332c628c3]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:35 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0 Jul 24 09:54:35 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:36 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0" returned: 0 in 0.662s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.bb286dc2-573d-4b69-bf22-19165eb5df4f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:36 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.bb286dc2-573d-4b69-bf22-19165eb5df4f Jul 24 09:54:36 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:37 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.bb286dc2-573d-4b69-bf22-19165eb5df4f" returned: 0 in 1.030s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.bb286dc2-573d-4b69-bf22-19165eb5df4f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:37 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.bb286dc2-573d-4b69-bf22-19165eb5df4f Jul 24 09:54:37 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:38 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0.bb286dc2-573d-4b69-bf22-19165eb5df4f" returned: 0 in 0.830s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] Lock "cinder-quobyte-bb286dc2-573d-4b69-bf22-19165eb5df4f" released by "_delete_snapshot" :: held 3.238s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] Lock "cinder-quobyte-d3268507-0ead-4e96-a0b2-7bd48d7b18c0" released by "delete_snapshot" :: held 3.280s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:38 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] Created reservations ['210e2343-611c-4f56-82ed-9c332d9ed18b', '3fd0259b-14cd-46b3-80fc-917a7698e7b6', 'a8826185-6111-4f9c-a68e-9d21f57723ec', 'da17c5e9-1d41-413e-a044-c0f571754cb7'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:38 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] Delete snapshot completed successfully. Jul 24 09:54:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2476a0bf-1aa4-4f37-ab64-a2d3dacbd714 tempest-CinderUnicodeTest-2064461473 None] Lock "cinder-bb286dc2-573d-4b69-bf22-19165eb5df4f-delete_snapshot" released by "delete_snapshot" :: held 3.665s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:39 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e79d47f4-2457-4b7e-b52c-e80cee32a457 tempest-CinderUnicodeTest-2064461473 None] Acquiring lock "cinder-d3268507-0ead-4e96-a0b2-7bd48d7b18c0-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:39 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e79d47f4-2457-4b7e-b52c-e80cee32a457 tempest-CinderUnicodeTest-2064461473 None] Lock "cinder-d3268507-0ead-4e96-a0b2-7bd48d7b18c0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:39 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e79d47f4-2457-4b7e-b52c-e80cee32a457 tempest-CinderUnicodeTest-2064461473 None] Acquiring lock "cinder-quobyte-d3268507-0ead-4e96-a0b2-7bd48d7b18c0" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:39 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e79d47f4-2457-4b7e-b52c-e80cee32a457 tempest-CinderUnicodeTest-2064461473 None] Lock "cinder-quobyte-d3268507-0ead-4e96-a0b2-7bd48d7b18c0" acquired by "delete_volume" :: waited 0.029s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:39 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e559ec6-b2a6-4774-8182-6fc9205e8348]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e79d47f4-2457-4b7e-b52c-e80cee32a457 tempest-CinderUnicodeTest-2064461473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:39 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0 Jul 24 09:54:39 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:39 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c701d19f-6732-4a92-ba3a-95d7b9d70378" returned: 0 in 5.101s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:39 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[504b5e30-e4dd-4484-b976-925b6948117a]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:40 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba Jul 24 09:54:40 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:40 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e79d47f4-2457-4b7e-b52c-e80cee32a457 tempest-CinderUnicodeTest-2064461473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0" returned: 0 in 0.488s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e79d47f4-2457-4b7e-b52c-e80cee32a457 tempest-CinderUnicodeTest-2064461473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:40 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0 Jul 24 09:54:40 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:40 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e79d47f4-2457-4b7e-b52c-e80cee32a457 tempest-CinderUnicodeTest-2064461473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d3268507-0ead-4e96-a0b2-7bd48d7b18c0" returned: 0 in 0.270s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e79d47f4-2457-4b7e-b52c-e80cee32a457 tempest-CinderUnicodeTest-2064461473 None] Lock "cinder-quobyte-d3268507-0ead-4e96-a0b2-7bd48d7b18c0" released by "delete_volume" :: held 0.877s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:40 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba" returned: 0 in 0.572s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba, size 1024.00 MB, duration 5.10 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c701d19f-6732-4a92-ba3a-95d7b9d70378 {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:54:40 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Converted 1024.00 MB image at 200.68 MB/s Jul 24 09:54:40 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c701d19f-6732-4a92-ba3a-95d7b9d70378 is being set with open permissions: ugo+rw Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c701d19f-6732-4a92-ba3a-95d7b9d70378 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:40 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c701d19f-6732-4a92-ba3a-95d7b9d70378 Jul 24 09:54:40 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-e79d47f4-2457-4b7e-b52c-e80cee32a457 tempest-CinderUnicodeTest-2064461473 None] Created reservations ['de6e240b-20bb-4027-a996-aaf8cd3917e9', 'fe193c78-77d5-4ae2-acba-da9a9a39bd60', 'c2cc769d-0d69-474a-aca8-17076f0a7258', '3ba25586-086f-49f0-8ce9-206e68d8d17b'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e79d47f4-2457-4b7e-b52c-e80cee32a457 tempest-CinderUnicodeTest-2064461473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e79d47f4-2457-4b7e-b52c-e80cee32a457 tempest-CinderUnicodeTest-2064461473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e79d47f4-2457-4b7e-b52c-e80cee32a457 tempest-CinderUnicodeTest-2064461473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e79d47f4-2457-4b7e-b52c-e80cee32a457 tempest-CinderUnicodeTest-2064461473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e79d47f4-2457-4b7e-b52c-e80cee32a457 tempest-CinderUnicodeTest-2064461473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e79d47f4-2457-4b7e-b52c-e80cee32a457 tempest-CinderUnicodeTest-2064461473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:40 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:40 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:40 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c701d19f-6732-4a92-ba3a-95d7b9d70378" returned: 0 in 0.263s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-57068d99-de49-497e-b30b-c9ddee7788ad tempest-CinderUnicodeTest-2064461473 None] Acquiring lock "cinder-bd58c5e6-b2df-4b30-b670-075d3f459e64-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Lock "cinder-quobyte-c701d19f-6732-4a92-ba3a-95d7b9d70378" released by "_copy_volume_from_snapshot" :: held 6.925s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-57068d99-de49-497e-b30b-c9ddee7788ad tempest-CinderUnicodeTest-2064461473 None] Lock "cinder-bd58c5e6-b2df-4b30-b670-075d3f459e64-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Lock "cinder-quobyte-69ec5678-60aa-45be-8109-95b52c694d3f-c701d19f-6732-4a92-ba3a-95d7b9d70378" released by "_create_volume_from_snapshot" :: held 7.009s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.059s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.237s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2064598286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d2e236-46e5-4885-886b-43afc332419b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579627f9f2774cdb91d2fbffae9e0f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:32Z,use_quota=True,user_id='a31483838e72474abfb6936e91784cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Creating volume 29d2e236-46e5-4885-886b-43afc332419b {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:40 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-29d2e236-46e5-4885-886b-43afc332419b 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:40 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-29d2e236-46e5-4885-886b-43afc332419b 1073741824 Jul 24 09:54:40 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-57068d99-de49-497e-b30b-c9ddee7788ad tempest-CinderUnicodeTest-2064461473 None] Acquiring lock "cinder-quobyte-bd58c5e6-b2df-4b30-b670-075d3f459e64" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00659cf2-f749-41aa-80b2-7b0316e8ea6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c701d19f-6732-4a92-ba3a-95d7b9d70378', 'volume_size': 1, 'snapshot_id': '69ec5678-60aa-45be-8109-95b52c694d3f'}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecee47ea-056f-4bfb-9117-880afec738ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-57068d99-de49-497e-b30b-c9ddee7788ad tempest-CinderUnicodeTest-2064461473 None] Lock "cinder-quobyte-bd58c5e6-b2df-4b30-b670-075d3f459e64" acquired by "delete_volume" :: waited 0.040s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:41 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Volume volume-c701d19f-6732-4a92-ba3a-95d7b9d70378 (c701d19f-6732-4a92-ba3a-95d7b9d70378): created successfully Jul 24 09:54:41 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecee47ea-056f-4bfb-9117-880afec738ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Flow 'volume_create_manager' (6566888d-9f03-4234-96c6-748b0de44eba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d1b334-7715-46f5-a258-dc925cbbff6c]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-57068d99-de49-497e-b30b-c9ddee7788ad tempest-CinderUnicodeTest-2064461473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd58c5e6-b2df-4b30-b670-075d3f459e64 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e79d47f4-2457-4b7e-b52c-e80cee32a457 tempest-CinderUnicodeTest-2064461473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.407s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-e79d47f4-2457-4b7e-b52c-e80cee32a457 tempest-CinderUnicodeTest-2064461473 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:41 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e79d47f4-2457-4b7e-b52c-e80cee32a457 tempest-CinderUnicodeTest-2064461473 None] Deleted volume successfully. Jul 24 09:54:41 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-9a6354e2-0c74-4cfa-a7ce-b995acab4a5c tempest-VolumeDependencyTests-1939256379 None] Created volume successfully. Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e79d47f4-2457-4b7e-b52c-e80cee32a457 tempest-CinderUnicodeTest-2064461473 None] Lock "cinder-d3268507-0ead-4e96-a0b2-7bd48d7b18c0-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:41 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd58c5e6-b2df-4b30-b670-075d3f459e64 Jul 24 09:54:41 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:41 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-29d2e236-46e5-4885-886b-43afc332419b 1073741824" returned: 0 in 0.549s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:41 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-57068d99-de49-497e-b30b-c9ddee7788ad tempest-CinderUnicodeTest-2064461473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd58c5e6-b2df-4b30-b670-075d3f459e64" returned: 0 in 0.441s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-57068d99-de49-497e-b30b-c9ddee7788ad tempest-CinderUnicodeTest-2064461473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd58c5e6-b2df-4b30-b670-075d3f459e64 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-29d2e236-46e5-4885-886b-43afc332419b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:41 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd58c5e6-b2df-4b30-b670-075d3f459e64 Jul 24 09:54:41 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:41 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-29d2e236-46e5-4885-886b-43afc332419b Jul 24 09:54:41 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:41 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-57068d99-de49-497e-b30b-c9ddee7788ad tempest-CinderUnicodeTest-2064461473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd58c5e6-b2df-4b30-b670-075d3f459e64" returned: 0 in 0.277s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-57068d99-de49-497e-b30b-c9ddee7788ad tempest-CinderUnicodeTest-2064461473 None] Lock "cinder-quobyte-bd58c5e6-b2df-4b30-b670-075d3f459e64" released by "delete_volume" :: held 0.777s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:41 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-29d2e236-46e5-4885-886b-43afc332419b" returned: 0 in 0.287s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.560s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-737732439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32eb6f23-d3da-4da0-a2cd-a687bf970d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579627f9f2774cdb91d2fbffae9e0f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:33Z,use_quota=True,user_id='a31483838e72474abfb6936e91784cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Creating volume 32eb6f23-d3da-4da0-a2cd-a687bf970d10 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:41 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-32eb6f23-d3da-4da0-a2cd-a687bf970d10 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:41 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-32eb6f23-d3da-4da0-a2cd-a687bf970d10 1073741824 Jul 24 09:54:41 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a5f37e-a88c-45a0-8e82-74a7d1446f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29d2e236-46e5-4885-886b-43afc332419b', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15af8965-41f3-4a4c-a7c8-8e5a310342ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:41 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Volume volume-29d2e236-46e5-4885-886b-43afc332419b (29d2e236-46e5-4885-886b-43afc332419b): created successfully Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15af8965-41f3-4a4c-a7c8-8e5a310342ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Flow 'volume_create_manager' (82063b41-8b94-4d3b-9fab-bb27a26419ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:41 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-a2a54b0c-a93e-4b67-a838-40369befb835 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Created volume successfully. Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-57068d99-de49-497e-b30b-c9ddee7788ad tempest-CinderUnicodeTest-2064461473 None] Created reservations ['f38f1397-afe7-4c43-90f7-25abb9a97ba8', 'fe4bb6cd-da69-417a-82af-53a6d59a69c1', '0fd96fa8-3e4e-4b8e-b015-b2366f98a88d', '5fc9e10f-827a-43e4-9d8b-a2666347de49'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-57068d99-de49-497e-b30b-c9ddee7788ad tempest-CinderUnicodeTest-2064461473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-57068d99-de49-497e-b30b-c9ddee7788ad tempest-CinderUnicodeTest-2064461473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-57068d99-de49-497e-b30b-c9ddee7788ad tempest-CinderUnicodeTest-2064461473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-57068d99-de49-497e-b30b-c9ddee7788ad tempest-CinderUnicodeTest-2064461473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-57068d99-de49-497e-b30b-c9ddee7788ad tempest-CinderUnicodeTest-2064461473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-57068d99-de49-497e-b30b-c9ddee7788ad tempest-CinderUnicodeTest-2064461473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:42 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:42 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] Acquiring lock "cinder-69ec5678-60aa-45be-8109-95b52c694d3f-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] Lock "cinder-69ec5678-60aa-45be-8109-95b52c694d3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] Acquiring lock "cinder-quobyte-f13d955d-306c-44ef-b320-7c6aabd895ba" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] Lock "cinder-quobyte-f13d955d-306c-44ef-b320-7c6aabd895ba" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] Acquiring lock "cinder-quobyte-69ec5678-60aa-45be-8109-95b52c694d3f" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] Lock "cinder-quobyte-69ec5678-60aa-45be-8109-95b52c694d3f" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] Deleting offline snapshot 69ec5678-60aa-45be-8109-95b52c694d3f of volume f13d955d-306c-44ef-b320-7c6aabd895ba {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] snapshot_file for this snap is: volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd5cd1b-2c7e-48db-8458-322f3dba3a17]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:42 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-57068d99-de49-497e-b30b-c9ddee7788ad tempest-CinderUnicodeTest-2064461473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.419s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-57068d99-de49-497e-b30b-c9ddee7788ad tempest-CinderUnicodeTest-2064461473 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:42 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-57068d99-de49-497e-b30b-c9ddee7788ad tempest-CinderUnicodeTest-2064461473 None] Deleted volume successfully. Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-57068d99-de49-497e-b30b-c9ddee7788ad tempest-CinderUnicodeTest-2064461473 None] Lock "cinder-bd58c5e6-b2df-4b30-b670-075d3f459e64-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:42 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f Jul 24 09:54:42 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:42 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-32eb6f23-d3da-4da0-a2cd-a687bf970d10 1073741824" returned: 0 in 0.737s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-32eb6f23-d3da-4da0-a2cd-a687bf970d10 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:42 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-32eb6f23-d3da-4da0-a2cd-a687bf970d10 Jul 24 09:54:42 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:42 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f" returned: 0 in 0.456s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f13d955d-306c-44ef-b320-7c6aabd895ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9a6609-19bf-4ec7-b867-9626e7e56979]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:42 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-32eb6f23-d3da-4da0-a2cd-a687bf970d10" returned: 0 in 0.280s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.275s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1030946039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6dc88e3-0929-4f8e-926a-1c72f002d508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579627f9f2774cdb91d2fbffae9e0f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:33Z,use_quota=True,user_id='a31483838e72474abfb6936e91784cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Creating volume d6dc88e3-0929-4f8e-926a-1c72f002d508 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:42 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d6dc88e3-0929-4f8e-926a-1c72f002d508 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:42 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d6dc88e3-0929-4f8e-926a-1c72f002d508 1073741824 Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e8ab6d-0668-4d29-a3bd-bb2c1269e874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32eb6f23-d3da-4da0-a2cd-a687bf970d10', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:42 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0eb3f06-c3ca-40c7-b229-1c8da1820614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:42 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Volume volume-32eb6f23-d3da-4da0-a2cd-a687bf970d10 (32eb6f23-d3da-4da0-a2cd-a687bf970d10): created successfully Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0eb3f06-c3ca-40c7-b229-1c8da1820614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:42 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba Jul 24 09:54:42 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:42 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Flow 'volume_create_manager' (3d0dadbb-004f-4844-9603-1cab1c69d762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:43 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-49bcd2a4-64d6-4b6b-9a10-5c01d9f7f47c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Created volume successfully. Jul 24 09:54:43 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba" returned: 0 in 0.510s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:43 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f Jul 24 09:54:43 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:43 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d6dc88e3-0929-4f8e-926a-1c72f002d508 1073741824" returned: 0 in 0.596s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d6dc88e3-0929-4f8e-926a-1c72f002d508 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:43 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d6dc88e3-0929-4f8e-926a-1c72f002d508 Jul 24 09:54:43 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:43 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f" returned: 0 in 0.425s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:43 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f Jul 24 09:54:43 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:43 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d6dc88e3-0929-4f8e-926a-1c72f002d508" returned: 0 in 0.342s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.813s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-753112483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd792126-a011-4056-8a14-888369ed086d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579627f9f2774cdb91d2fbffae9e0f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:34Z,use_quota=True,user_id='a31483838e72474abfb6936e91784cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Creating volume bd792126-a011-4056-8a14-888369ed086d {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:43 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd792126-a011-4056-8a14-888369ed086d 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3654a4f3-7898-4781-a081-28495942e9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6dc88e3-0929-4f8e-926a-1c72f002d508', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2525c7-3a8d-4e1a-87ff-af265363cae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:43 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Volume volume-d6dc88e3-0929-4f8e-926a-1c72f002d508 (d6dc88e3-0929-4f8e-926a-1c72f002d508): created successfully Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2525c7-3a8d-4e1a-87ff-af265363cae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:43 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd792126-a011-4056-8a14-888369ed086d 1073741824 Jul 24 09:54:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Flow 'volume_create_manager' (3d98382e-e9ee-4cce-8a54-fb6b4978e121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:43 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:43 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-9e3e671a-eff3-4d8a-9cf1-3e7a3ab95996 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Created volume successfully. Jul 24 09:54:44 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba.69ec5678-60aa-45be-8109-95b52c694d3f" returned: 0 in 0.325s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] Lock "cinder-quobyte-69ec5678-60aa-45be-8109-95b52c694d3f" released by "_delete_snapshot" :: held 1.849s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] Lock "cinder-quobyte-f13d955d-306c-44ef-b320-7c6aabd895ba" released by "delete_snapshot" :: held 1.889s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] Created reservations ['48de0157-4a30-4b7e-9551-4216c022ee6b', '53942f81-284b-4481-8626-27963df99114', 'b1bb6ffd-6503-49ef-a128-c9b6236c53be', 'fbb9d6a8-e9ed-4f4e-8e4f-edfe84689cb2'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:44 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] Delete snapshot completed successfully. Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-96b017cb-72cf-4285-a47f-30bc86a5c271 tempest-VolumeDependencyTests-1939256379 None] Lock "cinder-69ec5678-60aa-45be-8109-95b52c694d3f-delete_snapshot" released by "delete_snapshot" :: held 2.121s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-036fc442-438a-4755-a0d7-0926c9787e82 tempest-VolumeDependencyTests-1939256379 None] Acquiring lock "cinder-f13d955d-306c-44ef-b320-7c6aabd895ba-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-036fc442-438a-4755-a0d7-0926c9787e82 tempest-VolumeDependencyTests-1939256379 None] Lock "cinder-f13d955d-306c-44ef-b320-7c6aabd895ba-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-036fc442-438a-4755-a0d7-0926c9787e82 tempest-VolumeDependencyTests-1939256379 None] Acquiring lock "cinder-quobyte-f13d955d-306c-44ef-b320-7c6aabd895ba" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-036fc442-438a-4755-a0d7-0926c9787e82 tempest-VolumeDependencyTests-1939256379 None] Lock "cinder-quobyte-f13d955d-306c-44ef-b320-7c6aabd895ba" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:44 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd792126-a011-4056-8a14-888369ed086d 1073741824" returned: 0 in 0.698s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7854deae-c8de-4466-9835-156d852a347a]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-036fc442-438a-4755-a0d7-0926c9787e82 tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd792126-a011-4056-8a14-888369ed086d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:44 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd792126-a011-4056-8a14-888369ed086d Jul 24 09:54:44 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:44 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba Jul 24 09:54:44 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:44 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd792126-a011-4056-8a14-888369ed086d" returned: 0 in 0.305s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.586s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1629401676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=849ba4e1-4f8a-419b-a3a1-a65b8161e4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579627f9f2774cdb91d2fbffae9e0f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:34Z,use_quota=True,user_id='a31483838e72474abfb6936e91784cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Creating volume 849ba4e1-4f8a-419b-a3a1-a65b8161e4fd {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:44 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61c51a8-0296-4f03-9ad5-5a52b8073842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd792126-a011-4056-8a14-888369ed086d', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:44 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd 1073741824 Jul 24 09:54:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eeca539-95ef-4746-a6fb-eb084d6e92e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:44 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:45 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Volume volume-bd792126-a011-4056-8a14-888369ed086d (bd792126-a011-4056-8a14-888369ed086d): created successfully Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eeca539-95ef-4746-a6fb-eb084d6e92e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Flow 'volume_create_manager' (069dc377-4005-42a2-98e9-c65387d9d392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:45 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-f790fa3b-0f97-41ea-b6ef-24b6e0b87a71 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Created volume successfully. Jul 24 09:54:45 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-036fc442-438a-4755-a0d7-0926c9787e82 tempest-VolumeDependencyTests-1939256379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba" returned: 0 in 0.482s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-036fc442-438a-4755-a0d7-0926c9787e82 tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:45 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba Jul 24 09:54:45 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:45 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-036fc442-438a-4755-a0d7-0926c9787e82 tempest-VolumeDependencyTests-1939256379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f13d955d-306c-44ef-b320-7c6aabd895ba" returned: 0 in 0.268s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-036fc442-438a-4755-a0d7-0926c9787e82 tempest-VolumeDependencyTests-1939256379 None] Lock "cinder-quobyte-f13d955d-306c-44ef-b320-7c6aabd895ba" released by "delete_volume" :: held 0.846s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-036fc442-438a-4755-a0d7-0926c9787e82 tempest-VolumeDependencyTests-1939256379 None] Created reservations ['24ed42a2-413f-424e-b0dd-16f37879cfbe', '970a7b4c-7e23-4524-b55f-8f5e00a67c04', '5dcd3653-2909-410b-b3b7-3582faf1b4c0', 'deb6c014-f770-4d1b-b0fc-1b2178c714fa'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:45 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd 1073741824" returned: 0 in 0.561s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-036fc442-438a-4755-a0d7-0926c9787e82 tempest-VolumeDependencyTests-1939256379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-036fc442-438a-4755-a0d7-0926c9787e82 tempest-VolumeDependencyTests-1939256379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-036fc442-438a-4755-a0d7-0926c9787e82 tempest-VolumeDependencyTests-1939256379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-036fc442-438a-4755-a0d7-0926c9787e82 tempest-VolumeDependencyTests-1939256379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-036fc442-438a-4755-a0d7-0926c9787e82 tempest-VolumeDependencyTests-1939256379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-036fc442-438a-4755-a0d7-0926c9787e82 tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:45 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:45 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:45 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd Jul 24 09:54:45 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e073b81e-dfa3-4b44-8de6-51b7c20474b5 tempest-VolumeDependencyTests-1939256379 None] Acquiring lock "cinder-c701d19f-6732-4a92-ba3a-95d7b9d70378-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e073b81e-dfa3-4b44-8de6-51b7c20474b5 tempest-VolumeDependencyTests-1939256379 None] Lock "cinder-c701d19f-6732-4a92-ba3a-95d7b9d70378-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e073b81e-dfa3-4b44-8de6-51b7c20474b5 tempest-VolumeDependencyTests-1939256379 None] Acquiring lock "cinder-quobyte-c701d19f-6732-4a92-ba3a-95d7b9d70378" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e073b81e-dfa3-4b44-8de6-51b7c20474b5 tempest-VolumeDependencyTests-1939256379 None] Lock "cinder-quobyte-c701d19f-6732-4a92-ba3a-95d7b9d70378" acquired by "delete_volume" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2c3cdd-466f-468a-b99d-dd97d291d358]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e073b81e-dfa3-4b44-8de6-51b7c20474b5 tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c701d19f-6732-4a92-ba3a-95d7b9d70378 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:46 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-036fc442-438a-4755-a0d7-0926c9787e82 tempest-VolumeDependencyTests-1939256379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.483s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:46 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c701d19f-6732-4a92-ba3a-95d7b9d70378 Jul 24 09:54:46 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-036fc442-438a-4755-a0d7-0926c9787e82 tempest-VolumeDependencyTests-1939256379 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:46 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd" returned: 0 in 0.474s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:46 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-036fc442-438a-4755-a0d7-0926c9787e82 tempest-VolumeDependencyTests-1939256379 None] Deleted volume successfully. Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8a4188-f36d-486d-b8ef-b72269bdbcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d865b3-842f-4a12-8542-58bf1d15d902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:46 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Volume volume-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd (849ba4e1-4f8a-419b-a3a1-a65b8161e4fd): created successfully Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d865b3-842f-4a12-8542-58bf1d15d902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Flow 'volume_create_manager' (7e79593c-5d3a-4a2d-92bb-f8aafcdcca07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:46 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-630572ef-0d90-4d5a-b58a-cc15b6fd3d0c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Created volume successfully. Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-036fc442-438a-4755-a0d7-0926c9787e82 tempest-VolumeDependencyTests-1939256379 None] Lock "cinder-f13d955d-306c-44ef-b320-7c6aabd895ba-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:46 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e073b81e-dfa3-4b44-8de6-51b7c20474b5 tempest-VolumeDependencyTests-1939256379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c701d19f-6732-4a92-ba3a-95d7b9d70378" returned: 0 in 0.460s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e073b81e-dfa3-4b44-8de6-51b7c20474b5 tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c701d19f-6732-4a92-ba3a-95d7b9d70378 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:46 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c701d19f-6732-4a92-ba3a-95d7b9d70378 Jul 24 09:54:46 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-fd81be37-d60d-4d1d-8629-eca37b62bbea tempest-ProjectAdminTests-35107848 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88488) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 24 09:54:46 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e073b81e-dfa3-4b44-8de6-51b7c20474b5 tempest-VolumeDependencyTests-1939256379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c701d19f-6732-4a92-ba3a-95d7b9d70378" returned: 0 in 0.296s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e073b81e-dfa3-4b44-8de6-51b7c20474b5 tempest-VolumeDependencyTests-1939256379 None] Lock "cinder-quobyte-c701d19f-6732-4a92-ba3a-95d7b9d70378" released by "delete_volume" :: held 0.819s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-e073b81e-dfa3-4b44-8de6-51b7c20474b5 tempest-VolumeDependencyTests-1939256379 None] Created reservations ['fc1f28f9-a8da-4792-9056-d655688dfc31', 'd3d8ab16-67ef-41e0-96bb-ffdf10aaea9d', '03bc0f1f-11e8-43a4-a74a-83238c2d0942', '3a55a28f-28c4-41c7-9935-de1e04d29e0b'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e073b81e-dfa3-4b44-8de6-51b7c20474b5 tempest-VolumeDependencyTests-1939256379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e073b81e-dfa3-4b44-8de6-51b7c20474b5 tempest-VolumeDependencyTests-1939256379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e073b81e-dfa3-4b44-8de6-51b7c20474b5 tempest-VolumeDependencyTests-1939256379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e073b81e-dfa3-4b44-8de6-51b7c20474b5 tempest-VolumeDependencyTests-1939256379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e073b81e-dfa3-4b44-8de6-51b7c20474b5 tempest-VolumeDependencyTests-1939256379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e073b81e-dfa3-4b44-8de6-51b7c20474b5 tempest-VolumeDependencyTests-1939256379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:46 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:46 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2de3a1fd-2f46-4a90-9b0c-868df2ebdd98 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "cinder-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2de3a1fd-2f46-4a90-9b0c-868df2ebdd98 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2de3a1fd-2f46-4a90-9b0c-868df2ebdd98 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "cinder-quobyte-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2de3a1fd-2f46-4a90-9b0c-868df2ebdd98 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-quobyte-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:47 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e073b81e-dfa3-4b44-8de6-51b7c20474b5 tempest-VolumeDependencyTests-1939256379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.412s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:47 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-e073b81e-dfa3-4b44-8de6-51b7c20474b5 tempest-VolumeDependencyTests-1939256379 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:47 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e073b81e-dfa3-4b44-8de6-51b7c20474b5 tempest-VolumeDependencyTests-1939256379 None] Deleted volume successfully. Jul 24 09:54:47 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7b9042-235c-410b-95b3-a3ff2eb5e367]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2de3a1fd-2f46-4a90-9b0c-868df2ebdd98 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e073b81e-dfa3-4b44-8de6-51b7c20474b5 tempest-VolumeDependencyTests-1939256379 None] Lock "cinder-c701d19f-6732-4a92-ba3a-95d7b9d70378-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:47 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd Jul 24 09:54:47 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:47 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2de3a1fd-2f46-4a90-9b0c-868df2ebdd98 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd" returned: 0 in 0.468s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2de3a1fd-2f46-4a90-9b0c-868df2ebdd98 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:47 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd Jul 24 09:54:47 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:48 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2de3a1fd-2f46-4a90-9b0c-868df2ebdd98 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd" returned: 0 in 0.308s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2de3a1fd-2f46-4a90-9b0c-868df2ebdd98 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-quobyte-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd" released by "delete_volume" :: held 0.850s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:48 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-2de3a1fd-2f46-4a90-9b0c-868df2ebdd98 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Created reservations ['48843943-c0de-4979-92fe-63104c0a3c05', '7f89980c-ca3a-4c35-9c53-406a38abc33b', 'e865af51-389e-41e3-9ae1-ff3b44e08e1b', 'f926d494-ee9f-41b2-baa4-f721d9642937'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2de3a1fd-2f46-4a90-9b0c-868df2ebdd98 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2de3a1fd-2f46-4a90-9b0c-868df2ebdd98 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:48 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2de3a1fd-2f46-4a90-9b0c-868df2ebdd98 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:48 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-2de3a1fd-2f46-4a90-9b0c-868df2ebdd98 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-2de3a1fd-2f46-4a90-9b0c-868df2ebdd98 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2de3a1fd-2f46-4a90-9b0c-868df2ebdd98 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:48 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:48 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-24a63139-806b-4381-a536-c3cbf23029bd tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "cinder-bd792126-a011-4056-8a14-888369ed086d-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-24a63139-806b-4381-a536-c3cbf23029bd tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-bd792126-a011-4056-8a14-888369ed086d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-24a63139-806b-4381-a536-c3cbf23029bd tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "cinder-quobyte-bd792126-a011-4056-8a14-888369ed086d" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-24a63139-806b-4381-a536-c3cbf23029bd tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-quobyte-bd792126-a011-4056-8a14-888369ed086d" acquired by "delete_volume" :: waited 0.027s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:48 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7a3c5b-603b-4d50-810f-510fe72a5523]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-24a63139-806b-4381-a536-c3cbf23029bd tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd792126-a011-4056-8a14-888369ed086d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:48 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd792126-a011-4056-8a14-888369ed086d Jul 24 09:54:48 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:48 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-2de3a1fd-2f46-4a90-9b0c-868df2ebdd98 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.443s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:48 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-2de3a1fd-2f46-4a90-9b0c-868df2ebdd98 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:48 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-2de3a1fd-2f46-4a90-9b0c-868df2ebdd98 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Deleted volume successfully. Jul 24 09:54:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-2de3a1fd-2f46-4a90-9b0c-868df2ebdd98 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-849ba4e1-4f8a-419b-a3a1-a65b8161e4fd-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:48 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-24a63139-806b-4381-a536-c3cbf23029bd tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd792126-a011-4056-8a14-888369ed086d" returned: 0 in 0.463s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-24a63139-806b-4381-a536-c3cbf23029bd tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd792126-a011-4056-8a14-888369ed086d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:48 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd792126-a011-4056-8a14-888369ed086d Jul 24 09:54:48 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:49 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-24a63139-806b-4381-a536-c3cbf23029bd tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-bd792126-a011-4056-8a14-888369ed086d" returned: 0 in 0.303s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-24a63139-806b-4381-a536-c3cbf23029bd tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-quobyte-bd792126-a011-4056-8a14-888369ed086d" released by "delete_volume" :: held 0.833s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:49 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-24a63139-806b-4381-a536-c3cbf23029bd tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Created reservations ['92660a21-d901-4d4a-b6ae-c128598447f4', 'baced705-f06a-4208-9904-925465dac3f3', 'c9497c87-6d90-405e-9f8f-159154dedc39', '59c7652b-68f1-481f-91a0-1f488c3e23fb'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-24a63139-806b-4381-a536-c3cbf23029bd tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-24a63139-806b-4381-a536-c3cbf23029bd tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-24a63139-806b-4381-a536-c3cbf23029bd tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-24a63139-806b-4381-a536-c3cbf23029bd tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-24a63139-806b-4381-a536-c3cbf23029bd tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-24a63139-806b-4381-a536-c3cbf23029bd tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:49 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:49 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-12fb1827-5692-46e3-a759-c240f24f565c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "cinder-d6dc88e3-0929-4f8e-926a-1c72f002d508-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-12fb1827-5692-46e3-a759-c240f24f565c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-d6dc88e3-0929-4f8e-926a-1c72f002d508-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-12fb1827-5692-46e3-a759-c240f24f565c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "cinder-quobyte-d6dc88e3-0929-4f8e-926a-1c72f002d508" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-12fb1827-5692-46e3-a759-c240f24f565c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-quobyte-d6dc88e3-0929-4f8e-926a-1c72f002d508" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:49 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[152826ef-2a45-4a50-a530-a5b523ae814f]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-12fb1827-5692-46e3-a759-c240f24f565c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d6dc88e3-0929-4f8e-926a-1c72f002d508 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:49 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-24a63139-806b-4381-a536-c3cbf23029bd tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.355s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:49 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-24a63139-806b-4381-a536-c3cbf23029bd tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:49 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-24a63139-806b-4381-a536-c3cbf23029bd tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Deleted volume successfully. Jul 24 09:54:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-24a63139-806b-4381-a536-c3cbf23029bd tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-bd792126-a011-4056-8a14-888369ed086d-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:49 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d6dc88e3-0929-4f8e-926a-1c72f002d508 Jul 24 09:54:49 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:50 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-12fb1827-5692-46e3-a759-c240f24f565c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d6dc88e3-0929-4f8e-926a-1c72f002d508" returned: 0 in 0.390s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-12fb1827-5692-46e3-a759-c240f24f565c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d6dc88e3-0929-4f8e-926a-1c72f002d508 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:50 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d6dc88e3-0929-4f8e-926a-1c72f002d508 Jul 24 09:54:50 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:50 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-12fb1827-5692-46e3-a759-c240f24f565c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-d6dc88e3-0929-4f8e-926a-1c72f002d508" returned: 0 in 0.259s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:50 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-12fb1827-5692-46e3-a759-c240f24f565c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-quobyte-d6dc88e3-0929-4f8e-926a-1c72f002d508" released by "delete_volume" :: held 0.727s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:50 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-12fb1827-5692-46e3-a759-c240f24f565c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Created reservations ['4cad4918-e606-4a15-bdd8-e3c9796f4c7f', 'f4cee280-f5f7-43dd-8684-38764f43ebe0', '46f58e33-e6ee-4fc4-b0bf-8e9a6efcd59a', '785dc59a-ae30-42a7-a2a6-2aa86057ae6b'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-12fb1827-5692-46e3-a759-c240f24f565c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-12fb1827-5692-46e3-a759-c240f24f565c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:50 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-12fb1827-5692-46e3-a759-c240f24f565c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:50 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-12fb1827-5692-46e3-a759-c240f24f565c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-12fb1827-5692-46e3-a759-c240f24f565c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-12fb1827-5692-46e3-a759-c240f24f565c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:50 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:50 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:50 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e9b6a780-70f8-4b2a-a248-226f0f58c7c7 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "cinder-32eb6f23-d3da-4da0-a2cd-a687bf970d10-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:50 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e9b6a780-70f8-4b2a-a248-226f0f58c7c7 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-32eb6f23-d3da-4da0-a2cd-a687bf970d10-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:50 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e9b6a780-70f8-4b2a-a248-226f0f58c7c7 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "cinder-quobyte-32eb6f23-d3da-4da0-a2cd-a687bf970d10" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:50 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e9b6a780-70f8-4b2a-a248-226f0f58c7c7 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-quobyte-32eb6f23-d3da-4da0-a2cd-a687bf970d10" acquired by "delete_volume" :: waited 0.021s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:50 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b292365-feea-415c-ba8d-d3a9fbab67b3]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e9b6a780-70f8-4b2a-a248-226f0f58c7c7 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-32eb6f23-d3da-4da0-a2cd-a687bf970d10 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:50 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-12fb1827-5692-46e3-a759-c240f24f565c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.346s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:50 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-12fb1827-5692-46e3-a759-c240f24f565c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:50 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-12fb1827-5692-46e3-a759-c240f24f565c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Deleted volume successfully. Jul 24 09:54:50 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-12fb1827-5692-46e3-a759-c240f24f565c tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-d6dc88e3-0929-4f8e-926a-1c72f002d508-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:50 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-32eb6f23-d3da-4da0-a2cd-a687bf970d10 Jul 24 09:54:50 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:51 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e9b6a780-70f8-4b2a-a248-226f0f58c7c7 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-32eb6f23-d3da-4da0-a2cd-a687bf970d10" returned: 0 in 0.483s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e9b6a780-70f8-4b2a-a248-226f0f58c7c7 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-32eb6f23-d3da-4da0-a2cd-a687bf970d10 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:51 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-32eb6f23-d3da-4da0-a2cd-a687bf970d10 Jul 24 09:54:51 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Flow 'volume_create_manager' (48f6cb01-3bb1-4ef8-b2ef-11b38e53011c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:51 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e081c1e-1225-4c24-ae0c-433e0044c280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e9b6a780-70f8-4b2a-a248-226f0f58c7c7 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-32eb6f23-d3da-4da0-a2cd-a687bf970d10" returned: 0 in 0.330s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e081c1e-1225-4c24-ae0c-433e0044c280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1198042708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2cb99d6-f816-429b-9f53-c8f3a199839f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='812ba93cc8a2471481d261955fa394c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:52Z,use_quota=True,user_id='e8da93e408014ee486a76311ba130b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7fdedb-0d02-419c-b185-02401b2fcacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7fdedb-0d02-419c-b185-02401b2fcacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f844a83-9ebe-48f0-b194-372391cbd476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f844a83-9ebe-48f0-b194-372391cbd476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2cb99d6-f816-429b-9f53-c8f3a199839f', 'volume_name': 'volume-c2cb99d6-f816-429b-9f53-c8f3a199839f', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08975138-1580-4d26-961e-f6ed89832e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08975138-1580-4d26-961e-f6ed89832e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f85a50e-51b8-43a1-98ad-d343fa196e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:51 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Volume c2cb99d6-f816-429b-9f53-c8f3a199839f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2cb99d6-f816-429b-9f53-c8f3a199839f', 'volume_size': 1} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1198042708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2cb99d6-f816-429b-9f53-c8f3a199839f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='812ba93cc8a2471481d261955fa394c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:52Z,use_quota=True,user_id='e8da93e408014ee486a76311ba130b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Creating volume c2cb99d6-f816-429b-9f53-c8f3a199839f {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:51 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2cb99d6-f816-429b-9f53-c8f3a199839f 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e9b6a780-70f8-4b2a-a248-226f0f58c7c7 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-quobyte-32eb6f23-d3da-4da0-a2cd-a687bf970d10" released by "delete_volume" :: held 0.932s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:51 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2cb99d6-f816-429b-9f53-c8f3a199839f 1073741824 Jul 24 09:54:51 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-e9b6a780-70f8-4b2a-a248-226f0f58c7c7 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Created reservations ['9e4cfd07-41ed-4834-b28e-1428ae96b2a9', '933b4d87-448d-40e0-b85f-1057ea2c5bbb', '527d6362-e3ee-40b9-85fd-9f537b103e63', '50c80c1c-b7ec-4fdc-b2b8-9c79d4ec2420'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e9b6a780-70f8-4b2a-a248-226f0f58c7c7 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e9b6a780-70f8-4b2a-a248-226f0f58c7c7 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e9b6a780-70f8-4b2a-a248-226f0f58c7c7 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e9b6a780-70f8-4b2a-a248-226f0f58c7c7 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e9b6a780-70f8-4b2a-a248-226f0f58c7c7 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e9b6a780-70f8-4b2a-a248-226f0f58c7c7 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:51 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:51 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:52 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e9b6a780-70f8-4b2a-a248-226f0f58c7c7 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.313s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-e9b6a780-70f8-4b2a-a248-226f0f58c7c7 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:52 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e9b6a780-70f8-4b2a-a248-226f0f58c7c7 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Deleted volume successfully. Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e9b6a780-70f8-4b2a-a248-226f0f58c7c7 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-32eb6f23-d3da-4da0-a2cd-a687bf970d10-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:52 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2cb99d6-f816-429b-9f53-c8f3a199839f 1073741824" returned: 0 in 0.541s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2cb99d6-f816-429b-9f53-c8f3a199839f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:52 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2cb99d6-f816-429b-9f53-c8f3a199839f Jul 24 09:54:52 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:52 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2cb99d6-f816-429b-9f53-c8f3a199839f" returned: 0 in 0.324s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f85a50e-51b8-43a1-98ad-d343fa196e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2cb99d6-f816-429b-9f53-c8f3a199839f', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d74f590-64be-48f4-8bc1-2e5082922ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:52 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Volume volume-c2cb99d6-f816-429b-9f53-c8f3a199839f (c2cb99d6-f816-429b-9f53-c8f3a199839f): created successfully Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d74f590-64be-48f4-8bc1-2e5082922ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Flow 'volume_create_manager' (48f6cb01-3bb1-4ef8-b2ef-11b38e53011c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:52 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-0d729789-9799-45d0-ae94-f13571b9ea3f tempest-ProjectReaderTests-1413732855 None] Created volume successfully. Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Flow 'volume_create_manager' (0584f47c-3d5d-4693-9d4c-906ad323d237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4adbb5e1-d16b-429a-a0f8-5222782e8b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4adbb5e1-d16b-429a-a0f8-5222782e8b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1414196246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e5751c-849f-4b21-91bf-74333d4cb7fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f173c6fb30484362a9b610658bd4c1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:53Z,use_quota=True,user_id='970ee2f61cec4e3b8aa7dbb96c257be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f9cefd-3327-4b92-88eb-9a28792f361b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f9cefd-3327-4b92-88eb-9a28792f361b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3cbc2d3-ddfb-4be7-9663-ab4318bd4331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3cbc2d3-ddfb-4be7-9663-ab4318bd4331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1e5751c-849f-4b21-91bf-74333d4cb7fb', 'volume_name': 'volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d7b8de-2229-4491-b520-c1a60bc3cf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d7b8de-2229-4491-b520-c1a60bc3cf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d3082c-826e-444a-b0ff-b816d5df8bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:52 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Volume f1e5751c-849f-4b21-91bf-74333d4cb7fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb', 'volume_size': 1} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1414196246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e5751c-849f-4b21-91bf-74333d4cb7fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f173c6fb30484362a9b610658bd4c1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:53Z,use_quota=True,user_id='970ee2f61cec4e3b8aa7dbb96c257be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Creating volume f1e5751c-849f-4b21-91bf-74333d4cb7fb {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:52 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:52 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb 1073741824 Jul 24 09:54:52 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ad16b8f2-74b4-4272-9bb7-77ecfc1c7f06 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "cinder-29d2e236-46e5-4885-886b-43afc332419b-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ad16b8f2-74b4-4272-9bb7-77ecfc1c7f06 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-29d2e236-46e5-4885-886b-43afc332419b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ad16b8f2-74b4-4272-9bb7-77ecfc1c7f06 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "cinder-quobyte-29d2e236-46e5-4885-886b-43afc332419b" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ad16b8f2-74b4-4272-9bb7-77ecfc1c7f06 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-quobyte-29d2e236-46e5-4885-886b-43afc332419b" acquired by "delete_volume" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[887e92c5-f4dc-46cf-871a-db72f80d72af]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ad16b8f2-74b4-4272-9bb7-77ecfc1c7f06 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-29d2e236-46e5-4885-886b-43afc332419b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:53 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-29d2e236-46e5-4885-886b-43afc332419b Jul 24 09:54:53 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:53 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb 1073741824" returned: 0 in 0.495s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:53 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ad16b8f2-74b4-4272-9bb7-77ecfc1c7f06 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-29d2e236-46e5-4885-886b-43afc332419b" returned: 0 in 0.401s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ad16b8f2-74b4-4272-9bb7-77ecfc1c7f06 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-29d2e236-46e5-4885-886b-43afc332419b {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:53 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb Jul 24 09:54:53 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:53 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-29d2e236-46e5-4885-886b-43afc332419b Jul 24 09:54:53 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:53 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb" returned: 0 in 0.284s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d3082c-826e-444a-b0ff-b816d5df8bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:53 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2abf5ff5-43fd-4e77-b850-eecd07d3431a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ad16b8f2-74b4-4272-9bb7-77ecfc1c7f06 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-29d2e236-46e5-4885-886b-43afc332419b" returned: 0 in 0.294s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ad16b8f2-74b4-4272-9bb7-77ecfc1c7f06 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-quobyte-29d2e236-46e5-4885-886b-43afc332419b" released by "delete_volume" :: held 0.750s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:53 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Volume volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb (f1e5751c-849f-4b21-91bf-74333d4cb7fb): created successfully Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2abf5ff5-43fd-4e77-b850-eecd07d3431a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Flow 'volume_create_manager' (0584f47c-3d5d-4693-9d4c-906ad323d237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:53 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-46e3271a-48da-4c5c-b1ea-1093f2817554 tempest-ProjectReaderTests-1349320014 None] Created volume successfully. Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-ad16b8f2-74b4-4272-9bb7-77ecfc1c7f06 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Created reservations ['85344324-c1ca-407e-8b4b-70a324173e32', 'a798bb52-9e15-41f9-9c58-2cd0e1f34a37', 'a7f31209-892d-4a97-87bf-ad451066545a', '9d87ad50-68fa-49f2-bf8f-1c19a64823fa'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ad16b8f2-74b4-4272-9bb7-77ecfc1c7f06 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ad16b8f2-74b4-4272-9bb7-77ecfc1c7f06 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ad16b8f2-74b4-4272-9bb7-77ecfc1c7f06 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ad16b8f2-74b4-4272-9bb7-77ecfc1c7f06 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ad16b8f2-74b4-4272-9bb7-77ecfc1c7f06 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ad16b8f2-74b4-4272-9bb7-77ecfc1c7f06 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:53 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:53 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-56900253-01b2-45f7-95f8-d42706a6f13b tempest-ProjectReaderTests-1413732855 None] Acquiring lock "cinder-c2cb99d6-f816-429b-9f53-c8f3a199839f-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-56900253-01b2-45f7-95f8-d42706a6f13b tempest-ProjectReaderTests-1413732855 None] Lock "cinder-c2cb99d6-f816-429b-9f53-c8f3a199839f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-56900253-01b2-45f7-95f8-d42706a6f13b tempest-ProjectReaderTests-1413732855 None] Acquiring lock "cinder-quobyte-c2cb99d6-f816-429b-9f53-c8f3a199839f" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-56900253-01b2-45f7-95f8-d42706a6f13b tempest-ProjectReaderTests-1413732855 None] Lock "cinder-quobyte-c2cb99d6-f816-429b-9f53-c8f3a199839f" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:54 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa7921e-3d5e-4dbb-8196-0b51148a5191]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-56900253-01b2-45f7-95f8-d42706a6f13b tempest-ProjectReaderTests-1413732855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2cb99d6-f816-429b-9f53-c8f3a199839f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d078f271-0664-43ad-9837-7b2521ebd115 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "cinder-df379013-aa73-4ef6-a735-cfbe8341854e-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d078f271-0664-43ad-9837-7b2521ebd115 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-df379013-aa73-4ef6-a735-cfbe8341854e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d078f271-0664-43ad-9837-7b2521ebd115 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "cinder-quobyte-df379013-aa73-4ef6-a735-cfbe8341854e" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d078f271-0664-43ad-9837-7b2521ebd115 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-quobyte-df379013-aa73-4ef6-a735-cfbe8341854e" acquired by "delete_volume" :: waited 0.021s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:54 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ded7ee-71c2-4517-ae86-eeb17386a42b]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d078f271-0664-43ad-9837-7b2521ebd115 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df379013-aa73-4ef6-a735-cfbe8341854e {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:54 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ad16b8f2-74b4-4272-9bb7-77ecfc1c7f06 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.391s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:54 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-ad16b8f2-74b4-4272-9bb7-77ecfc1c7f06 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:54 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-ad16b8f2-74b4-4272-9bb7-77ecfc1c7f06 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Deleted volume successfully. Jul 24 09:54:54 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2cb99d6-f816-429b-9f53-c8f3a199839f Jul 24 09:54:54 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ad16b8f2-74b4-4272-9bb7-77ecfc1c7f06 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-29d2e236-46e5-4885-886b-43afc332419b-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:54 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df379013-aa73-4ef6-a735-cfbe8341854e Jul 24 09:54:54 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:54 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-56900253-01b2-45f7-95f8-d42706a6f13b tempest-ProjectReaderTests-1413732855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2cb99d6-f816-429b-9f53-c8f3a199839f" returned: 0 in 0.433s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-56900253-01b2-45f7-95f8-d42706a6f13b tempest-ProjectReaderTests-1413732855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2cb99d6-f816-429b-9f53-c8f3a199839f {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:54 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2cb99d6-f816-429b-9f53-c8f3a199839f Jul 24 09:54:54 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:54 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d078f271-0664-43ad-9837-7b2521ebd115 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df379013-aa73-4ef6-a735-cfbe8341854e" returned: 0 in 0.412s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d078f271-0664-43ad-9837-7b2521ebd115 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df379013-aa73-4ef6-a735-cfbe8341854e {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:54 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df379013-aa73-4ef6-a735-cfbe8341854e Jul 24 09:54:54 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:54 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-56900253-01b2-45f7-95f8-d42706a6f13b tempest-ProjectReaderTests-1413732855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-c2cb99d6-f816-429b-9f53-c8f3a199839f" returned: 0 in 0.284s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-56900253-01b2-45f7-95f8-d42706a6f13b tempest-ProjectReaderTests-1413732855 None] Lock "cinder-quobyte-c2cb99d6-f816-429b-9f53-c8f3a199839f" released by "delete_volume" :: held 0.775s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:54 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-56900253-01b2-45f7-95f8-d42706a6f13b tempest-ProjectReaderTests-1413732855 None] Created reservations ['4978dca6-6045-42ee-a255-72faaebf95e7', 'e6128bbf-c272-464a-9569-c50260eea933', '23943983-006d-475f-9019-8dec8b473114', '5bf6708f-4cb7-4c37-9fcb-868e48f168a1'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:55 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d078f271-0664-43ad-9837-7b2521ebd115 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-df379013-aa73-4ef6-a735-cfbe8341854e" returned: 0 in 0.287s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d078f271-0664-43ad-9837-7b2521ebd115 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-quobyte-df379013-aa73-4ef6-a735-cfbe8341854e" released by "delete_volume" :: held 0.775s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-56900253-01b2-45f7-95f8-d42706a6f13b tempest-ProjectReaderTests-1413732855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-56900253-01b2-45f7-95f8-d42706a6f13b tempest-ProjectReaderTests-1413732855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-56900253-01b2-45f7-95f8-d42706a6f13b tempest-ProjectReaderTests-1413732855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-56900253-01b2-45f7-95f8-d42706a6f13b tempest-ProjectReaderTests-1413732855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-56900253-01b2-45f7-95f8-d42706a6f13b tempest-ProjectReaderTests-1413732855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-56900253-01b2-45f7-95f8-d42706a6f13b tempest-ProjectReaderTests-1413732855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-d078f271-0664-43ad-9837-7b2521ebd115 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Created reservations ['8d852bdb-cf61-4a5e-b847-8300015a86b9', '20a7b4bb-9bd5-452e-b878-2816854a3e04', '2785339b-89c0-43fd-90be-7c6afb97cc31', '59c32879-5c07-4bf2-bdf2-bd2213d25e06'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:54:55 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:55 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ae0cc4db-eec8-4d1f-a38d-5db1a4441d74 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ae0cc4db-eec8-4d1f-a38d-5db1a4441d74 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-ae0cc4db-eec8-4d1f-a38d-5db1a4441d74 tempest-ProjectReaderTests-1349320014 None] Creating offline snapshot 4cfca32d-971c-41c8-9a46-02898c5583f9 of volume f1e5751c-849f-4b21-91bf-74333d4cb7fb {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a806bcd-a452-4791-b413-fcc5ef3b281a]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ae0cc4db-eec8-4d1f-a38d-5db1a4441d74 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d078f271-0664-43ad-9837-7b2521ebd115 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d078f271-0664-43ad-9837-7b2521ebd115 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d078f271-0664-43ad-9837-7b2521ebd115 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d078f271-0664-43ad-9837-7b2521ebd115 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d078f271-0664-43ad-9837-7b2521ebd115 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d078f271-0664-43ad-9837-7b2521ebd115 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:55 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:54:55 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:55 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb Jul 24 09:54:55 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:55 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-56900253-01b2-45f7-95f8-d42706a6f13b tempest-ProjectReaderTests-1413732855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.463s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-56900253-01b2-45f7-95f8-d42706a6f13b tempest-ProjectReaderTests-1413732855 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:55 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-56900253-01b2-45f7-95f8-d42706a6f13b tempest-ProjectReaderTests-1413732855 None] Deleted volume successfully. Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-56900253-01b2-45f7-95f8-d42706a6f13b tempest-ProjectReaderTests-1413732855 None] Lock "cinder-c2cb99d6-f816-429b-9f53-c8f3a199839f-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:55 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ae0cc4db-eec8-4d1f-a38d-5db1a4441d74 tempest-ProjectReaderTests-1349320014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb" returned: 0 in 0.686s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ae0cc4db-eec8-4d1f-a38d-5db1a4441d74 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.4cfca32d-971c-41c8-9a46-02898c5583f9 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:55 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.4cfca32d-971c-41c8-9a46-02898c5583f9 1G Jul 24 09:54:55 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:55 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d078f271-0664-43ad-9837-7b2521ebd115 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.588s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:55 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-d078f271-0664-43ad-9837-7b2521ebd115 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:54:55 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d078f271-0664-43ad-9837-7b2521ebd115 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Deleted volume successfully. Jul 24 09:54:56 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Flow 'volume_create_manager' (577819e2-f728-49b6-a7a0-e49b2edaf29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c97ba4e-f6f6-48fa-9d47-858441ce9bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c97ba4e-f6f6-48fa-9d47-858441ce9bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-882855224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec63ea7-abf4-4ee0-8059-c0de21398f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='812ba93cc8a2471481d261955fa394c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:56Z,use_quota=True,user_id='e8da93e408014ee486a76311ba130b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60500e35-0e99-446f-a03a-ebd55920a911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60500e35-0e99-446f-a03a-ebd55920a911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c317ec32-8773-4d32-b451-ee3c75b8cb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c317ec32-8773-4d32-b451-ee3c75b8cb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ec63ea7-abf4-4ee0-8059-c0de21398f20', 'volume_name': 'volume-1ec63ea7-abf4-4ee0-8059-c0de21398f20', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3611883d-2b01-49a0-88b4-20a94ba21fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3611883d-2b01-49a0-88b4-20a94ba21fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:56 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cafa5955-fd87-4a6b-9766-5144bca80967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:56 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Volume 1ec63ea7-abf4-4ee0-8059-c0de21398f20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ec63ea7-abf4-4ee0-8059-c0de21398f20', 'volume_size': 1} Jul 24 09:54:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d078f271-0664-43ad-9837-7b2521ebd115 tempest-CreateVolumesFromSourceVolumeTest-373044868 None] Lock "cinder-df379013-aa73-4ef6-a735-cfbe8341854e-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:54:56 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ae0cc4db-eec8-4d1f-a38d-5db1a4441d74 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.4cfca32d-971c-41c8-9a46-02898c5583f9 1G" returned: 0 in 0.547s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ae0cc4db-eec8-4d1f-a38d-5db1a4441d74 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.4cfca32d-971c-41c8-9a46-02898c5583f9 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:56 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.4cfca32d-971c-41c8-9a46-02898c5583f9 Jul 24 09:54:56 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:56 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ae0cc4db-eec8-4d1f-a38d-5db1a4441d74 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.4cfca32d-971c-41c8-9a46-02898c5583f9" returned: 0 in 0.328s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:56 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-ae0cc4db-eec8-4d1f-a38d-5db1a4441d74 tempest-ProjectReaderTests-1349320014 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.4cfca32d-971c-41c8-9a46-02898c5583f9 is being set with open permissions: ugo+rw Jul 24 09:54:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ae0cc4db-eec8-4d1f-a38d-5db1a4441d74 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.4cfca32d-971c-41c8-9a46-02898c5583f9 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:56 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.4cfca32d-971c-41c8-9a46-02898c5583f9 Jul 24 09:54:56 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:57 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ae0cc4db-eec8-4d1f-a38d-5db1a4441d74 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.4cfca32d-971c-41c8-9a46-02898c5583f9" returned: 0 in 0.282s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ae0cc4db-eec8-4d1f-a38d-5db1a4441d74 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:57 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.info Jul 24 09:54:57 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:57 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ae0cc4db-eec8-4d1f-a38d-5db1a4441d74 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.info" returned: 0 in 0.273s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:57 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-ae0cc4db-eec8-4d1f-a38d-5db1a4441d74 tempest-ProjectReaderTests-1349320014 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.info is being set with open permissions: ugo+rw Jul 24 09:54:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ae0cc4db-eec8-4d1f-a38d-5db1a4441d74 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:57 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.info Jul 24 09:54:57 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:57 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ae0cc4db-eec8-4d1f-a38d-5db1a4441d74 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.info" returned: 0 in 0.250s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ae0cc4db-eec8-4d1f-a38d-5db1a4441d74 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.484s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.560s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:57 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-882855224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec63ea7-abf4-4ee0-8059-c0de21398f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='812ba93cc8a2471481d261955fa394c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:54:56Z,use_quota=True,user_id='e8da93e408014ee486a76311ba130b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:57 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Creating volume 1ec63ea7-abf4-4ee0-8059-c0de21398f20 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:57 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:57 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:57 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:57 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ec63ea7-abf4-4ee0-8059-c0de21398f20 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:57 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ec63ea7-abf4-4ee0-8059-c0de21398f20 1073741824 Jul 24 09:54:57 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:57 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-ae0cc4db-eec8-4d1f-a38d-5db1a4441d74 tempest-ProjectReaderTests-1349320014 None] Create snapshot completed successfully Jul 24 09:54:57 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=222,cinder:UPDATE=278,cinder:INSERT=83,cinder:DELETE=25 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:54:58 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ec63ea7-abf4-4ee0-8059-c0de21398f20 1073741824" returned: 0 in 0.501s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:58 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=306,cinder:SELECT=204,cinder:DELETE=28,cinder:INSERT=72 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:54:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ec63ea7-abf4-4ee0-8059-c0de21398f20 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:58 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ec63ea7-abf4-4ee0-8059-c0de21398f20 Jul 24 09:54:58 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-4cfca32d-971c-41c8-9a46-02898c5583f9-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-4cfca32d-971c-41c8-9a46-02898c5583f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-quobyte-f1e5751c-849f-4b21-91bf-74333d4cb7fb" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:58 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-f1e5751c-849f-4b21-91bf-74333d4cb7fb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-quobyte-4cfca32d-971c-41c8-9a46-02898c5583f9" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ec63ea7-abf4-4ee0-8059-c0de21398f20" returned: 0 in 0.346s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:54:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-4cfca32d-971c-41c8-9a46-02898c5583f9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] Deleting offline snapshot 4cfca32d-971c-41c8-9a46-02898c5583f9 of volume f1e5751c-849f-4b21-91bf-74333d4cb7fb {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:54:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] snapshot_file for this snap is: volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.4cfca32d-971c-41c8-9a46-02898c5583f9 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:54:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cafa5955-fd87-4a6b-9766-5144bca80967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec63ea7-abf4-4ee0-8059-c0de21398f20', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e45e09-8621-4672-a420-d1649185ac30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:58 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b63c40a-11f4-4cc5-842d-f7ba70d85f98]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.4cfca32d-971c-41c8-9a46-02898c5583f9 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:58 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Volume volume-1ec63ea7-abf4-4ee0-8059-c0de21398f20 (1ec63ea7-abf4-4ee0-8059-c0de21398f20): created successfully Jul 24 09:54:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e45e09-8621-4672-a420-d1649185ac30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Flow 'volume_create_manager' (577819e2-f728-49b6-a7a0-e49b2edaf29e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:58 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-54f767bb-61ec-45e9-8656-90f65567bdc8 tempest-ProjectReaderTests-1413732855 None] Created volume successfully. Jul 24 09:54:58 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.4cfca32d-971c-41c8-9a46-02898c5583f9 Jul 24 09:54:58 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:59 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.4cfca32d-971c-41c8-9a46-02898c5583f9" returned: 0 in 0.425s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[124234a0-f8cb-467e-8a52-29de27b6344f]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:59 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb Jul 24 09:54:59 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b3979828-529c-41f0-8df0-9ea7d86faae6 tempest-ProjectReaderTests-1413732855 None] Acquiring lock "cinder-1ec63ea7-abf4-4ee0-8059-c0de21398f20-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b3979828-529c-41f0-8df0-9ea7d86faae6 tempest-ProjectReaderTests-1413732855 None] Lock "cinder-1ec63ea7-abf4-4ee0-8059-c0de21398f20-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b3979828-529c-41f0-8df0-9ea7d86faae6 tempest-ProjectReaderTests-1413732855 None] Acquiring lock "cinder-quobyte-1ec63ea7-abf4-4ee0-8059-c0de21398f20" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b3979828-529c-41f0-8df0-9ea7d86faae6 tempest-ProjectReaderTests-1413732855 None] Lock "cinder-quobyte-1ec63ea7-abf4-4ee0-8059-c0de21398f20" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea15c958-ca00-47e9-8b56-300fefcc507a]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b3979828-529c-41f0-8df0-9ea7d86faae6 tempest-ProjectReaderTests-1413732855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ec63ea7-abf4-4ee0-8059-c0de21398f20 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:59 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:59 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ec63ea7-abf4-4ee0-8059-c0de21398f20 Jul 24 09:54:59 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb" returned: 0 in 0.445s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.4cfca32d-971c-41c8-9a46-02898c5583f9 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:59 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.4cfca32d-971c-41c8-9a46-02898c5583f9 Jul 24 09:54:59 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Flow 'volume_create_manager' (28775ddf-5bb4-40cd-8ff6-6c1bceb788c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a06ee48c-0a66-44ce-a2ee-430d3078aa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a06ee48c-0a66-44ce-a2ee-430d3078aa0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-550683159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03eacfb7-6278-4972-8496-eb0b8636e9ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b587ba61104b63b86e5a657e21be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:00Z,use_quota=True,user_id='bb693ea0a87140e195a91cab5d5e34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3e468d-8f0f-489e-9664-9c7397d23936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3e468d-8f0f-489e-9664-9c7397d23936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90320f1-e7b4-4285-947d-16e5153c4b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90320f1-e7b4-4285-947d-16e5153c4b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03eacfb7-6278-4972-8496-eb0b8636e9ce', 'volume_name': 'volume-03eacfb7-6278-4972-8496-eb0b8636e9ce', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e8e395-db79-4d70-919e-df75f51cd3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e8e395-db79-4d70-919e-df75f51cd3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8f47f0-6650-4432-a939-09df6284615d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:54:59 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Volume 03eacfb7-6278-4972-8496-eb0b8636e9ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03eacfb7-6278-4972-8496-eb0b8636e9ce', 'volume_size': 1} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-550683159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03eacfb7-6278-4972-8496-eb0b8636e9ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b587ba61104b63b86e5a657e21be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:00Z,use_quota=True,user_id='bb693ea0a87140e195a91cab5d5e34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Creating volume 03eacfb7-6278-4972-8496-eb0b8636e9ce {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:54:59 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:59 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b3979828-529c-41f0-8df0-9ea7d86faae6 tempest-ProjectReaderTests-1413732855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ec63ea7-abf4-4ee0-8059-c0de21398f20" returned: 0 in 0.565s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:54:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b3979828-529c-41f0-8df0-9ea7d86faae6 tempest-ProjectReaderTests-1413732855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ec63ea7-abf4-4ee0-8059-c0de21398f20 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:54:59 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce 1073741824 Jul 24 09:54:59 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:00 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ec63ea7-abf4-4ee0-8059-c0de21398f20 Jul 24 09:55:00 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:00 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.4cfca32d-971c-41c8-9a46-02898c5583f9" returned: 0 in 0.513s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.4cfca32d-971c-41c8-9a46-02898c5583f9 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:00 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.4cfca32d-971c-41c8-9a46-02898c5583f9 Jul 24 09:55:00 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:00 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b3979828-529c-41f0-8df0-9ea7d86faae6 tempest-ProjectReaderTests-1413732855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-1ec63ea7-abf4-4ee0-8059-c0de21398f20" returned: 0 in 0.304s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b3979828-529c-41f0-8df0-9ea7d86faae6 tempest-ProjectReaderTests-1413732855 None] Lock "cinder-quobyte-1ec63ea7-abf4-4ee0-8059-c0de21398f20" released by "delete_volume" :: held 0.930s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-b3979828-529c-41f0-8df0-9ea7d86faae6 tempest-ProjectReaderTests-1413732855 None] Created reservations ['41c36281-d09e-440e-aa2c-3c4451043d9b', '83f52317-0444-447d-8439-57639083961e', '942ef025-a717-4560-aabb-0ab705fd6deb', '7594003d-f6dd-4482-a608-0dd88288b7d5'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b3979828-529c-41f0-8df0-9ea7d86faae6 tempest-ProjectReaderTests-1413732855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b3979828-529c-41f0-8df0-9ea7d86faae6 tempest-ProjectReaderTests-1413732855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b3979828-529c-41f0-8df0-9ea7d86faae6 tempest-ProjectReaderTests-1413732855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:00 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-b3979828-529c-41f0-8df0-9ea7d86faae6 tempest-ProjectReaderTests-1413732855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b3979828-529c-41f0-8df0-9ea7d86faae6 tempest-ProjectReaderTests-1413732855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b3979828-529c-41f0-8df0-9ea7d86faae6 tempest-ProjectReaderTests-1413732855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb.4cfca32d-971c-41c8-9a46-02898c5583f9" returned: 0 in 0.355s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:00 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:55:00 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-4cfca32d-971c-41c8-9a46-02898c5583f9" released by "_delete_snapshot" :: held 1.883s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-f1e5751c-849f-4b21-91bf-74333d4cb7fb" released by "delete_snapshot" :: held 1.917s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:00 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce 1073741824" returned: 0 in 0.570s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:00 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce Jul 24 09:55:00 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] Created reservations ['7b70fed3-9985-46ee-949b-887a19dea55b', 'ae9ca1d6-22e9-4dc4-9cb8-a981e01affeb', 'cdfafbfe-4785-4268-96a0-4806a7405d23', '74b03680-32df-4333-b556-8a7633f60674'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:00 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] Delete snapshot completed successfully. Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-23a25ea2-ced3-4a30-8cc6-8a934714c7d9 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-4cfca32d-971c-41c8-9a46-02898c5583f9-delete_snapshot" released by "delete_snapshot" :: held 2.123s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:00 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b3979828-529c-41f0-8df0-9ea7d86faae6 tempest-ProjectReaderTests-1413732855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.360s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-b3979828-529c-41f0-8df0-9ea7d86faae6 tempest-ProjectReaderTests-1413732855 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:55:00 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b3979828-529c-41f0-8df0-9ea7d86faae6 tempest-ProjectReaderTests-1413732855 None] Deleted volume successfully. Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-52c5716d-e67d-45bb-af23-12f85c7170a2 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-f1e5751c-849f-4b21-91bf-74333d4cb7fb-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-b3979828-529c-41f0-8df0-9ea7d86faae6 tempest-ProjectReaderTests-1413732855 None] Lock "cinder-1ec63ea7-abf4-4ee0-8059-c0de21398f20-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-52c5716d-e67d-45bb-af23-12f85c7170a2 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-f1e5751c-849f-4b21-91bf-74333d4cb7fb-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-52c5716d-e67d-45bb-af23-12f85c7170a2 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-quobyte-f1e5751c-849f-4b21-91bf-74333d4cb7fb" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:00 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce" returned: 0 in 0.400s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:00 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-52c5716d-e67d-45bb-af23-12f85c7170a2 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-f1e5751c-849f-4b21-91bf-74333d4cb7fb" acquired by "delete_volume" :: waited 0.027s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8f47f0-6650-4432-a939-09df6284615d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03eacfb7-6278-4972-8496-eb0b8636e9ce', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656c75be-7584-426e-bdc0-6d4d79a54408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:01 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db555ec-2ae0-43c7-923f-6f81d52ac35e]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-52c5716d-e67d-45bb-af23-12f85c7170a2 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:01 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Volume volume-03eacfb7-6278-4972-8496-eb0b8636e9ce (03eacfb7-6278-4972-8496-eb0b8636e9ce): created successfully Jul 24 09:55:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656c75be-7584-426e-bdc0-6d4d79a54408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:01 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Flow 'volume_create_manager' (28775ddf-5bb4-40cd-8ff6-6c1bceb788c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:01 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-62a7d126-8d2a-4158-a918-e25a5b10892a tempest-ProjectMemberTests-949013298 None] Created volume successfully. Jul 24 09:55:01 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb Jul 24 09:55:01 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:01 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-52c5716d-e67d-45bb-af23-12f85c7170a2 tempest-ProjectReaderTests-1349320014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb" returned: 0 in 0.431s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-52c5716d-e67d-45bb-af23-12f85c7170a2 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:01 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb Jul 24 09:55:01 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:01 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-52c5716d-e67d-45bb-af23-12f85c7170a2 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f1e5751c-849f-4b21-91bf-74333d4cb7fb" returned: 0 in 0.289s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:01 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-52c5716d-e67d-45bb-af23-12f85c7170a2 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-f1e5751c-849f-4b21-91bf-74333d4cb7fb" released by "delete_volume" :: held 0.809s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:01 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-52c5716d-e67d-45bb-af23-12f85c7170a2 tempest-ProjectReaderTests-1349320014 None] Created reservations ['ff4ea569-c745-4f65-940e-0733e124bc7e', '30040688-4b62-4257-9279-6ea2a39d36c9', 'bfda8dd1-35f6-40c0-8aa3-c5cace1cffe4', 'd7a2fdca-9ebb-4fa1-974b-34166ef57de8'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-52c5716d-e67d-45bb-af23-12f85c7170a2 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-52c5716d-e67d-45bb-af23-12f85c7170a2 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-52c5716d-e67d-45bb-af23-12f85c7170a2 tempest-ProjectReaderTests-1349320014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:01 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-52c5716d-e67d-45bb-af23-12f85c7170a2 tempest-ProjectReaderTests-1349320014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-52c5716d-e67d-45bb-af23-12f85c7170a2 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-52c5716d-e67d-45bb-af23-12f85c7170a2 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:01 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:55:01 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:02 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-52c5716d-e67d-45bb-af23-12f85c7170a2 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.497s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:02 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-52c5716d-e67d-45bb-af23-12f85c7170a2 tempest-ProjectReaderTests-1349320014 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:55:02 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-52c5716d-e67d-45bb-af23-12f85c7170a2 tempest-ProjectReaderTests-1349320014 None] Deleted volume successfully. Jul 24 09:55:02 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-52c5716d-e67d-45bb-af23-12f85c7170a2 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-f1e5751c-849f-4b21-91bf-74333d4cb7fb-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ba1a9132-3ffd-4bee-adfa-bd0ab0704b31 tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ba1a9132-3ffd-4bee-adfa-bd0ab0704b31 tempest-ProjectMemberTests-949013298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:02 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:55:02 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Flow 'volume_create_manager' (6c816ad6-c7d1-45de-8b96-f750265526b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:02 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0e9f7d-775d-48b3-b56b-41f28db3b2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:02 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-ba1a9132-3ffd-4bee-adfa-bd0ab0704b31 tempest-ProjectMemberTests-949013298 None] Creating offline snapshot 5b76f1db-2eec-4789-9552-19666b0ec480 of volume 03eacfb7-6278-4972-8496-eb0b8636e9ce {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:55:02 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0e9f7d-775d-48b3-b56b-41f28db3b2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1785865231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3096f80-c98a-49dc-902a-8da865af7481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f173c6fb30484362a9b610658bd4c1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:03Z,use_quota=True,user_id='970ee2f61cec4e3b8aa7dbb96c257be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:02 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1e1497-bbeb-40df-b9af-88f5fbdcfa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:02 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1e1497-bbeb-40df-b9af-88f5fbdcfa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:02 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2733e57e-7f87-43d8-93f5-f8e422c15044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:02 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2733e57e-7f87-43d8-93f5-f8e422c15044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3096f80-c98a-49dc-902a-8da865af7481', 'volume_name': 'volume-a3096f80-c98a-49dc-902a-8da865af7481', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:02 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb596662-7f6d-4b6a-a24c-d70ffe8b3ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:02 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb596662-7f6d-4b6a-a24c-d70ffe8b3ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:02 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f64edd7-8b65-46f9-a618-2c401e1fbe9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:02 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Volume a3096f80-c98a-49dc-902a-8da865af7481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3096f80-c98a-49dc-902a-8da865af7481', 'volume_size': 1} Jul 24 09:55:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:02 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[28564c69-0874-4224-b215-66ebdc7e9b1a]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ba1a9132-3ffd-4bee-adfa-bd0ab0704b31 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:02 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce Jul 24 09:55:02 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:03 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ba1a9132-3ffd-4bee-adfa-bd0ab0704b31 tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce" returned: 0 in 0.382s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ba1a9132-3ffd-4bee-adfa-bd0ab0704b31 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.5b76f1db-2eec-4789-9552-19666b0ec480 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:03 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.5b76f1db-2eec-4789-9552-19666b0ec480 1G Jul 24 09:55:03 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:03 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ba1a9132-3ffd-4bee-adfa-bd0ab0704b31 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.5b76f1db-2eec-4789-9552-19666b0ec480 1G" returned: 0 in 0.415s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ba1a9132-3ffd-4bee-adfa-bd0ab0704b31 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03eacfb7-6278-4972-8496-eb0b8636e9ce -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.5b76f1db-2eec-4789-9552-19666b0ec480 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:03 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03eacfb7-6278-4972-8496-eb0b8636e9ce -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.5b76f1db-2eec-4789-9552-19666b0ec480 Jul 24 09:55:03 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:03 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ba1a9132-3ffd-4bee-adfa-bd0ab0704b31 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03eacfb7-6278-4972-8496-eb0b8636e9ce -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.5b76f1db-2eec-4789-9552-19666b0ec480" returned: 0 in 0.291s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:03 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-ba1a9132-3ffd-4bee-adfa-bd0ab0704b31 tempest-ProjectMemberTests-949013298 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.5b76f1db-2eec-4789-9552-19666b0ec480 is being set with open permissions: ugo+rw Jul 24 09:55:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ba1a9132-3ffd-4bee-adfa-bd0ab0704b31 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.5b76f1db-2eec-4789-9552-19666b0ec480 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:04 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.5b76f1db-2eec-4789-9552-19666b0ec480 Jul 24 09:55:04 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:04 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ba1a9132-3ffd-4bee-adfa-bd0ab0704b31 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.5b76f1db-2eec-4789-9552-19666b0ec480" returned: 0 in 0.251s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ba1a9132-3ffd-4bee-adfa-bd0ab0704b31 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:04 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.info Jul 24 09:55:04 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:04 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ba1a9132-3ffd-4bee-adfa-bd0ab0704b31 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.info" returned: 0 in 0.266s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:04 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-ba1a9132-3ffd-4bee-adfa-bd0ab0704b31 tempest-ProjectMemberTests-949013298 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.info is being set with open permissions: ugo+rw Jul 24 09:55:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ba1a9132-3ffd-4bee-adfa-bd0ab0704b31 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:04 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.info Jul 24 09:55:04 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:04 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ba1a9132-3ffd-4bee-adfa-bd0ab0704b31 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.info" returned: 0 in 0.248s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ba1a9132-3ffd-4bee-adfa-bd0ab0704b31 tempest-ProjectMemberTests-949013298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.939s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1785865231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3096f80-c98a-49dc-902a-8da865af7481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f173c6fb30484362a9b610658bd4c1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:03Z,use_quota=True,user_id='970ee2f61cec4e3b8aa7dbb96c257be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:55:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Creating volume a3096f80-c98a-49dc-902a-8da865af7481 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:55:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:04 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:55:04 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:55:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:04 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481 1073741824 Jul 24 09:55:04 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:04 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-ba1a9132-3ffd-4bee-adfa-bd0ab0704b31 tempest-ProjectMemberTests-949013298 None] Create snapshot completed successfully Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Flow 'volume_create_manager' (37c31df8-ffd2-424d-ab14-15daa0015d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed3099a-2b49-4847-9ecf-736dd6352c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed3099a-2b49-4847-9ecf-736dd6352c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1175285120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a0c686-69a7-44e2-98f5-eef91407ed36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0438e97b33f347f2b744d041f07ab559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:05Z,use_quota=True,user_id='7941b54a126f4f50b1fb719af22e5a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdd8b09-5fba-42f1-95c1-67366f919684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdd8b09-5fba-42f1-95c1-67366f919684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:05 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2044ccaa-1965-4916-a0c9-d3f12220b110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2044ccaa-1965-4916-a0c9-d3f12220b110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a0c686-69a7-44e2-98f5-eef91407ed36', 'volume_name': 'volume-54a0c686-69a7-44e2-98f5-eef91407ed36', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a11a6ec-faeb-47d0-adc6-7b53f8a6e8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a11a6ec-faeb-47d0-adc6-7b53f8a6e8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45888473-253c-4b1a-b874-70fcd7e69478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:05 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Volume 54a0c686-69a7-44e2-98f5-eef91407ed36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a0c686-69a7-44e2-98f5-eef91407ed36', 'volume_size': 1} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481 1073741824" returned: 0 in 0.485s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:05 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481 Jul 24 09:55:05 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:05 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481" returned: 0 in 0.239s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.275s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1175285120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a0c686-69a7-44e2-98f5-eef91407ed36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0438e97b33f347f2b744d041f07ab559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:05Z,use_quota=True,user_id='7941b54a126f4f50b1fb719af22e5a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Creating volume 54a0c686-69a7-44e2-98f5-eef91407ed36 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:55:05 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54a0c686-69a7-44e2-98f5-eef91407ed36 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:05 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54a0c686-69a7-44e2-98f5-eef91407ed36 1073741824 Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f64edd7-8b65-46f9-a618-2c401e1fbe9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3096f80-c98a-49dc-902a-8da865af7481', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:05 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d481611-5fd0-43e7-a86c-8f2a4243d774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:05 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Volume volume-a3096f80-c98a-49dc-902a-8da865af7481 (a3096f80-c98a-49dc-902a-8da865af7481): created successfully Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d481611-5fd0-43e7-a86c-8f2a4243d774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Flow 'volume_create_manager' (6c816ad6-c7d1-45de-8b96-f750265526b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:05 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e02a811a-3275-430a-8cb5-0e15e6206c80 tempest-ProjectReaderTests-1349320014 None] Created volume successfully. Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-5b76f1db-2eec-4789-9552-19666b0ec480-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] Lock "cinder-5b76f1db-2eec-4789-9552-19666b0ec480-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-03eacfb7-6278-4972-8496-eb0b8636e9ce" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-03eacfb7-6278-4972-8496-eb0b8636e9ce" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-5b76f1db-2eec-4789-9552-19666b0ec480" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-5b76f1db-2eec-4789-9552-19666b0ec480" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] Deleting offline snapshot 5b76f1db-2eec-4789-9552-19666b0ec480 of volume 03eacfb7-6278-4972-8496-eb0b8636e9ce {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] snapshot_file for this snap is: volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.5b76f1db-2eec-4789-9552-19666b0ec480 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41919c5-d475-44b0-8d96-1ea56ab8fce6]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.5b76f1db-2eec-4789-9552-19666b0ec480 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-40ad483f-798e-455a-b954-9bb558e9c7b2 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:06 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54a0c686-69a7-44e2-98f5-eef91407ed36 1073741824" returned: 0 in 0.490s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:06 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.5b76f1db-2eec-4789-9552-19666b0ec480 Jul 24 09:55:06 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54a0c686-69a7-44e2-98f5-eef91407ed36 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:06 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54a0c686-69a7-44e2-98f5-eef91407ed36 Jul 24 09:55:06 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:06 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.5b76f1db-2eec-4789-9552-19666b0ec480" returned: 0 in 0.382s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03eacfb7-6278-4972-8496-eb0b8636e9ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:55:06 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54a0c686-69a7-44e2-98f5-eef91407ed36" returned: 0 in 0.261s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-40ad483f-798e-455a-b954-9bb558e9c7b2 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.343s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ff18bd-a9da-42bf-9132-b26339fa9397]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45888473-253c-4b1a-b874-70fcd7e69478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a0c686-69a7-44e2-98f5-eef91407ed36', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd26b70-7032-4003-86e0-a46a6a477aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-40ad483f-798e-455a-b954-9bb558e9c7b2 tempest-ProjectReaderTests-1349320014 None] Creating offline snapshot ee67d90b-19b5-43ee-b279-d0ab2570e028 of volume a3096f80-c98a-49dc-902a-8da865af7481 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:55:06 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Volume volume-54a0c686-69a7-44e2-98f5-eef91407ed36 (54a0c686-69a7-44e2-98f5-eef91407ed36): created successfully Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd26b70-7032-4003-86e0-a46a6a477aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Flow 'volume_create_manager' (37c31df8-ffd2-424d-ab14-15daa0015d9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[666f7c18-6240-4518-9fc2-bc7124087757]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-40ad483f-798e-455a-b954-9bb558e9c7b2 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:06 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-4a2111c6-ceef-4448-a1e6-017ee619b9c0 tempest-ProjectReaderTests-1759236468 None] Created volume successfully. Jul 24 09:55:06 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce Jul 24 09:55:06 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:06 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481 Jul 24 09:55:06 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:06 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce" returned: 0 in 0.369s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.5b76f1db-2eec-4789-9552-19666b0ec480 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:06 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.5b76f1db-2eec-4789-9552-19666b0ec480 Jul 24 09:55:06 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:06 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-40ad483f-798e-455a-b954-9bb558e9c7b2 tempest-ProjectReaderTests-1349320014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481" returned: 0 in 0.373s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-40ad483f-798e-455a-b954-9bb558e9c7b2 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.ee67d90b-19b5-43ee-b279-d0ab2570e028 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:06 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.ee67d90b-19b5-43ee-b279-d0ab2570e028 1G Jul 24 09:55:06 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:07 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.5b76f1db-2eec-4789-9552-19666b0ec480" returned: 0 in 0.336s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.5b76f1db-2eec-4789-9552-19666b0ec480 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:07 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.5b76f1db-2eec-4789-9552-19666b0ec480 Jul 24 09:55:07 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:07 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-40ad483f-798e-455a-b954-9bb558e9c7b2 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.ee67d90b-19b5-43ee-b279-d0ab2570e028 1G" returned: 0 in 0.411s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-40ad483f-798e-455a-b954-9bb558e9c7b2 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3096f80-c98a-49dc-902a-8da865af7481 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.ee67d90b-19b5-43ee-b279-d0ab2570e028 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:07 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3096f80-c98a-49dc-902a-8da865af7481 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.ee67d90b-19b5-43ee-b279-d0ab2570e028 Jul 24 09:55:07 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:07 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce.5b76f1db-2eec-4789-9552-19666b0ec480" returned: 0 in 0.263s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-5b76f1db-2eec-4789-9552-19666b0ec480" released by "_delete_snapshot" :: held 1.491s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-03eacfb7-6278-4972-8496-eb0b8636e9ce" released by "delete_snapshot" :: held 1.528s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ee757f20-7574-4847-a5f7-e0d74963c066 tempest-ProjectReaderTests-1759236468 None] Acquiring lock "cinder-54a0c686-69a7-44e2-98f5-eef91407ed36-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ee757f20-7574-4847-a5f7-e0d74963c066 tempest-ProjectReaderTests-1759236468 None] Lock "cinder-54a0c686-69a7-44e2-98f5-eef91407ed36-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:07 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] Created reservations ['aea94791-7b82-4130-add6-38850a051939', '3a41efdd-1013-4a54-aae8-1e6077189386', 'fab9c356-bef2-4621-8095-8fb3ca443711', '0576b829-686e-49c3-8a88-7784bd57d875'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ee757f20-7574-4847-a5f7-e0d74963c066 tempest-ProjectReaderTests-1759236468 None] Acquiring lock "cinder-quobyte-54a0c686-69a7-44e2-98f5-eef91407ed36" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ee757f20-7574-4847-a5f7-e0d74963c066 tempest-ProjectReaderTests-1759236468 None] Lock "cinder-quobyte-54a0c686-69a7-44e2-98f5-eef91407ed36" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:07 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-40ad483f-798e-455a-b954-9bb558e9c7b2 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3096f80-c98a-49dc-902a-8da865af7481 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.ee67d90b-19b5-43ee-b279-d0ab2570e028" returned: 0 in 0.337s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:07 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-40ad483f-798e-455a-b954-9bb558e9c7b2 tempest-ProjectReaderTests-1349320014 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.ee67d90b-19b5-43ee-b279-d0ab2570e028 is being set with open permissions: ugo+rw Jul 24 09:55:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-40ad483f-798e-455a-b954-9bb558e9c7b2 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.ee67d90b-19b5-43ee-b279-d0ab2570e028 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:07 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[51db1794-45df-4d96-9bc5-fb29f077e8b5]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ee757f20-7574-4847-a5f7-e0d74963c066 tempest-ProjectReaderTests-1759236468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54a0c686-69a7-44e2-98f5-eef91407ed36 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:07 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.ee67d90b-19b5-43ee-b279-d0ab2570e028 Jul 24 09:55:07 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:07 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] Delete snapshot completed successfully. Jul 24 09:55:07 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fa440e73-d147-430b-8771-a134742f3a7d tempest-ProjectMemberTests-949013298 None] Lock "cinder-5b76f1db-2eec-4789-9552-19666b0ec480-delete_snapshot" released by "delete_snapshot" :: held 1.772s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:07 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54a0c686-69a7-44e2-98f5-eef91407ed36 Jul 24 09:55:07 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:07 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-40ad483f-798e-455a-b954-9bb558e9c7b2 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.ee67d90b-19b5-43ee-b279-d0ab2570e028" returned: 0 in 0.251s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-40ad483f-798e-455a-b954-9bb558e9c7b2 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:07 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.info Jul 24 09:55:07 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:08 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ee757f20-7574-4847-a5f7-e0d74963c066 tempest-ProjectReaderTests-1759236468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54a0c686-69a7-44e2-98f5-eef91407ed36" returned: 0 in 0.403s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ee757f20-7574-4847-a5f7-e0d74963c066 tempest-ProjectReaderTests-1759236468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54a0c686-69a7-44e2-98f5-eef91407ed36 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5e8b9d35-324f-4bf5-92c4-4d82f796561c tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-03eacfb7-6278-4972-8496-eb0b8636e9ce-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:08 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54a0c686-69a7-44e2-98f5-eef91407ed36 Jul 24 09:55:08 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5e8b9d35-324f-4bf5-92c4-4d82f796561c tempest-ProjectMemberTests-949013298 None] Lock "cinder-03eacfb7-6278-4972-8496-eb0b8636e9ce-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5e8b9d35-324f-4bf5-92c4-4d82f796561c tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-03eacfb7-6278-4972-8496-eb0b8636e9ce" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5e8b9d35-324f-4bf5-92c4-4d82f796561c tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-03eacfb7-6278-4972-8496-eb0b8636e9ce" acquired by "delete_volume" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:08 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-40ad483f-798e-455a-b954-9bb558e9c7b2 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.info" returned: 0 in 0.304s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:08 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-40ad483f-798e-455a-b954-9bb558e9c7b2 tempest-ProjectReaderTests-1349320014 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.info is being set with open permissions: ugo+rw Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-40ad483f-798e-455a-b954-9bb558e9c7b2 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fbe0dd-5c9d-42e8-bfd7-82b285ed8609]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5e8b9d35-324f-4bf5-92c4-4d82f796561c tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:08 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.info Jul 24 09:55:08 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:08 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce Jul 24 09:55:08 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:08 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ee757f20-7574-4847-a5f7-e0d74963c066 tempest-ProjectReaderTests-1759236468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-54a0c686-69a7-44e2-98f5-eef91407ed36" returned: 0 in 0.297s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ee757f20-7574-4847-a5f7-e0d74963c066 tempest-ProjectReaderTests-1759236468 None] Lock "cinder-quobyte-54a0c686-69a7-44e2-98f5-eef91407ed36" released by "delete_volume" :: held 0.755s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-ee757f20-7574-4847-a5f7-e0d74963c066 tempest-ProjectReaderTests-1759236468 None] Created reservations ['a7510ebe-a742-41db-8e9c-98bfdadd990b', 'a5557d26-7782-404d-90b0-486bffc8723d', 'acadcf84-0fe2-4d9f-bbaf-d0949bb356b9', 'e79ee665-ea62-4e2c-a4ef-4581e2f766d3'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:08 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-40ad483f-798e-455a-b954-9bb558e9c7b2 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.info" returned: 0 in 0.262s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-40ad483f-798e-455a-b954-9bb558e9c7b2 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ee757f20-7574-4847-a5f7-e0d74963c066 tempest-ProjectReaderTests-1759236468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ee757f20-7574-4847-a5f7-e0d74963c066 tempest-ProjectReaderTests-1759236468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ee757f20-7574-4847-a5f7-e0d74963c066 tempest-ProjectReaderTests-1759236468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ee757f20-7574-4847-a5f7-e0d74963c066 tempest-ProjectReaderTests-1759236468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ee757f20-7574-4847-a5f7-e0d74963c066 tempest-ProjectReaderTests-1759236468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ee757f20-7574-4847-a5f7-e0d74963c066 tempest-ProjectReaderTests-1759236468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:08 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-40ad483f-798e-455a-b954-9bb558e9c7b2 tempest-ProjectReaderTests-1349320014 None] Create snapshot completed successfully Jul 24 09:55:08 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:55:08 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:08 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5e8b9d35-324f-4bf5-92c4-4d82f796561c tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce" returned: 0 in 0.385s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5e8b9d35-324f-4bf5-92c4-4d82f796561c tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:08 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce Jul 24 09:55:08 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:08 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ee757f20-7574-4847-a5f7-e0d74963c066 tempest-ProjectReaderTests-1759236468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.262s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-ee757f20-7574-4847-a5f7-e0d74963c066 tempest-ProjectReaderTests-1759236468 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:55:08 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-ee757f20-7574-4847-a5f7-e0d74963c066 tempest-ProjectReaderTests-1759236468 None] Deleted volume successfully. Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ee757f20-7574-4847-a5f7-e0d74963c066 tempest-ProjectReaderTests-1759236468 None] Lock "cinder-54a0c686-69a7-44e2-98f5-eef91407ed36-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:08 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5e8b9d35-324f-4bf5-92c4-4d82f796561c tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-03eacfb7-6278-4972-8496-eb0b8636e9ce" returned: 0 in 0.260s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5e8b9d35-324f-4bf5-92c4-4d82f796561c tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-03eacfb7-6278-4972-8496-eb0b8636e9ce" released by "delete_volume" :: held 0.710s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-5e8b9d35-324f-4bf5-92c4-4d82f796561c tempest-ProjectMemberTests-949013298 None] Created reservations ['91d38a82-47f7-41e3-9889-5dda2c15e5db', '273ae53f-3250-481d-a1c3-2ecdb1250602', 'faae115e-555e-415d-af85-8955860cb525', '1f0ecad1-bea2-4756-9eaa-853872719ea9'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5e8b9d35-324f-4bf5-92c4-4d82f796561c tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5e8b9d35-324f-4bf5-92c4-4d82f796561c tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-5e8b9d35-324f-4bf5-92c4-4d82f796561c tempest-ProjectMemberTests-949013298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-5e8b9d35-324f-4bf5-92c4-4d82f796561c tempest-ProjectMemberTests-949013298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-5e8b9d35-324f-4bf5-92c4-4d82f796561c tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5e8b9d35-324f-4bf5-92c4-4d82f796561c tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:09 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:55:09 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Flow 'volume_create_manager' (27cd7ee9-cf42-4dfd-80ef-a2e472997827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d89c32c7-074b-40e9-a317-a3d010e3d5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d89c32c7-074b-40e9-a317-a3d010e3d5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1168732117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c3637c-a631-47e0-8641-e88f7e8100ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0438e97b33f347f2b744d041f07ab559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:09Z,use_quota=True,user_id='7941b54a126f4f50b1fb719af22e5a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0960cdcf-aa74-4910-aaba-50d195899661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0960cdcf-aa74-4910-aaba-50d195899661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20aa5ad8-3d33-48c9-b2f4-f2f82d4ceda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20aa5ad8-3d33-48c9-b2f4-f2f82d4ceda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87c3637c-a631-47e0-8641-e88f7e8100ca', 'volume_name': 'volume-87c3637c-a631-47e0-8641-e88f7e8100ca', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c98ddbc3-3875-497a-8952-4f830049e46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c98ddbc3-3875-497a-8952-4f830049e46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e22d9a5-2b68-481c-94dc-a398b423150d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:09 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Volume 87c3637c-a631-47e0-8641-e88f7e8100ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87c3637c-a631-47e0-8641-e88f7e8100ca', 'volume_size': 1} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1168732117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c3637c-a631-47e0-8641-e88f7e8100ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0438e97b33f347f2b744d041f07ab559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:09Z,use_quota=True,user_id='7941b54a126f4f50b1fb719af22e5a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Creating volume 87c3637c-a631-47e0-8641-e88f7e8100ca {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:55:09 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87c3637c-a631-47e0-8641-e88f7e8100ca 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:09 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-ee67d90b-19b5-43ee-b279-d0ab2570e028-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-5e8b9d35-324f-4bf5-92c4-4d82f796561c tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.295s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-5e8b9d35-324f-4bf5-92c4-4d82f796561c tempest-ProjectMemberTests-949013298 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:55:09 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87c3637c-a631-47e0-8641-e88f7e8100ca 1073741824 Jul 24 09:55:09 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:09 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-5e8b9d35-324f-4bf5-92c4-4d82f796561c tempest-ProjectMemberTests-949013298 None] Deleted volume successfully. Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] Lock "cinder-ee67d90b-19b5-43ee-b279-d0ab2570e028-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-quobyte-a3096f80-c98a-49dc-902a-8da865af7481" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-a3096f80-c98a-49dc-902a-8da865af7481" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-quobyte-ee67d90b-19b5-43ee-b279-d0ab2570e028" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-5e8b9d35-324f-4bf5-92c4-4d82f796561c tempest-ProjectMemberTests-949013298 None] Lock "cinder-03eacfb7-6278-4972-8496-eb0b8636e9ce-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-ee67d90b-19b5-43ee-b279-d0ab2570e028" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] Deleting offline snapshot ee67d90b-19b5-43ee-b279-d0ab2570e028 of volume a3096f80-c98a-49dc-902a-8da865af7481 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] snapshot_file for this snap is: volume-a3096f80-c98a-49dc-902a-8da865af7481.ee67d90b-19b5-43ee-b279-d0ab2570e028 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f61c07-63c4-4cc0-b3d6-b7e01c2c0f64]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.ee67d90b-19b5-43ee-b279-d0ab2570e028 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:09 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.ee67d90b-19b5-43ee-b279-d0ab2570e028 Jul 24 09:55:09 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Flow 'volume_create_manager' (7ce61828-a71e-4b6f-ae2b-8b2c6f785e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7a8d10-c33b-448a-bb4a-97cbedff265b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7a8d10-c33b-448a-bb4a-97cbedff265b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1054030944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b587ba61104b63b86e5a657e21be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:10Z,use_quota=True,user_id='bb693ea0a87140e195a91cab5d5e34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:09 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d38799-718c-478b-89a3-cbeb3c2536e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d38799-718c-478b-89a3-cbeb3c2536e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9f5262-6202-4f31-8a60-2af141413044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9f5262-6202-4f31-8a60-2af141413044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e', 'volume_name': 'volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be857f0a-3419-4d1b-af0c-aca5a5c05270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be857f0a-3419-4d1b-af0c-aca5a5c05270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35de2c44-b143-4dc3-87da-7d6e02aea250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:09 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Volume f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e', 'volume_size': 1} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87c3637c-a631-47e0-8641-e88f7e8100ca 1073741824" returned: 0 in 0.526s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87c3637c-a631-47e0-8641-e88f7e8100ca {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:09 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.ee67d90b-19b5-43ee-b279-d0ab2570e028" returned: 0 in 0.437s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3096f80-c98a-49dc-902a-8da865af7481(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:55:09 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87c3637c-a631-47e0-8641-e88f7e8100ca Jul 24 09:55:09 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4242a79-a32b-495f-a1dc-4fc3a037444d]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:09 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481 Jul 24 09:55:09 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:10 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87c3637c-a631-47e0-8641-e88f7e8100ca" returned: 0 in 0.257s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.295s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1054030944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b587ba61104b63b86e5a657e21be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:10Z,use_quota=True,user_id='bb693ea0a87140e195a91cab5d5e34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Creating volume f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:55:10 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e22d9a5-2b68-481c-94dc-a398b423150d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87c3637c-a631-47e0-8641-e88f7e8100ca', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:10 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e 1073741824 Jul 24 09:55:10 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b8cf57e-acde-463c-bfe4-2e923ab7a90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:10 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Volume volume-87c3637c-a631-47e0-8641-e88f7e8100ca (87c3637c-a631-47e0-8641-e88f7e8100ca): created successfully Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b8cf57e-acde-463c-bfe4-2e923ab7a90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Flow 'volume_create_manager' (27cd7ee9-cf42-4dfd-80ef-a2e472997827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:10 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d4da4769-08f6-49f3-9602-1cf09232955c tempest-ProjectReaderTests-1759236468 None] Created volume successfully. Jul 24 09:55:10 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481" returned: 0 in 0.377s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.ee67d90b-19b5-43ee-b279-d0ab2570e028 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:10 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.ee67d90b-19b5-43ee-b279-d0ab2570e028 Jul 24 09:55:10 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:10 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e 1073741824" returned: 0 in 0.434s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:10 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e Jul 24 09:55:10 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:10 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.ee67d90b-19b5-43ee-b279-d0ab2570e028" returned: 0 in 0.381s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.ee67d90b-19b5-43ee-b279-d0ab2570e028 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:10 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.ee67d90b-19b5-43ee-b279-d0ab2570e028 Jul 24 09:55:10 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:10 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e" returned: 0 in 0.251s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35de2c44-b143-4dc3-87da-7d6e02aea250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b837f636-91b5-4a81-a89c-d291e67edfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:10 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Volume volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e (f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e): created successfully Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b837f636-91b5-4a81-a89c-d291e67edfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Flow 'volume_create_manager' (7ce61828-a71e-4b6f-ae2b-8b2c6f785e55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:10 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481.ee67d90b-19b5-43ee-b279-d0ab2570e028" returned: 0 in 0.245s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:10 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-86e11f5b-af5f-4130-9dbd-e462a8509d3b tempest-ProjectMemberTests-949013298 None] Created volume successfully. Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-ee67d90b-19b5-43ee-b279-d0ab2570e028" released by "_delete_snapshot" :: held 1.554s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-a3096f80-c98a-49dc-902a-8da865af7481" released by "delete_snapshot" :: held 1.583s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:10 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] Created reservations ['a4c6f731-b3b3-48e7-87f6-bb086e752163', 'd4eaff69-e832-41a1-a845-4bc005e22ecd', '5ec544c5-b593-4a11-afd4-574d76a39c7e', 'dd4db63b-0b27-497e-9682-fa37c65e9420'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:11 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] Delete snapshot completed successfully. Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6715f96c-ffb3-4c9f-9077-3e768514828d tempest-ProjectReaderTests-1349320014 None] Lock "cinder-ee67d90b-19b5-43ee-b279-d0ab2570e028-delete_snapshot" released by "delete_snapshot" :: held 1.715s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ad3848ae-4661-450a-9d38-92ba64d8dc34 tempest-ProjectReaderTests-1759236468 None] Acquiring lock "cinder-87c3637c-a631-47e0-8641-e88f7e8100ca-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ad3848ae-4661-450a-9d38-92ba64d8dc34 tempest-ProjectReaderTests-1759236468 None] Lock "cinder-87c3637c-a631-47e0-8641-e88f7e8100ca-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ad3848ae-4661-450a-9d38-92ba64d8dc34 tempest-ProjectReaderTests-1759236468 None] Acquiring lock "cinder-quobyte-87c3637c-a631-47e0-8641-e88f7e8100ca" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ad3848ae-4661-450a-9d38-92ba64d8dc34 tempest-ProjectReaderTests-1759236468 None] Lock "cinder-quobyte-87c3637c-a631-47e0-8641-e88f7e8100ca" acquired by "delete_volume" :: waited 0.013s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6960c3fa-41d2-4489-80c0-bd9a147e5e75]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ad3848ae-4661-450a-9d38-92ba64d8dc34 tempest-ProjectReaderTests-1759236468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87c3637c-a631-47e0-8641-e88f7e8100ca {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d4106579-dee0-474e-9809-72587c2620ac tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-a3096f80-c98a-49dc-902a-8da865af7481-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d4106579-dee0-474e-9809-72587c2620ac tempest-ProjectReaderTests-1349320014 None] Lock "cinder-a3096f80-c98a-49dc-902a-8da865af7481-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d4106579-dee0-474e-9809-72587c2620ac tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-quobyte-a3096f80-c98a-49dc-902a-8da865af7481" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d4106579-dee0-474e-9809-72587c2620ac tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-a3096f80-c98a-49dc-902a-8da865af7481" acquired by "delete_volume" :: waited 0.021s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:11 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87c3637c-a631-47e0-8641-e88f7e8100ca Jul 24 09:55:11 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[53670938-803d-4c27-97c4-d56864e095de]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d4106579-dee0-474e-9809-72587c2620ac tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:11 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481 Jul 24 09:55:11 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:11 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ad3848ae-4661-450a-9d38-92ba64d8dc34 tempest-ProjectReaderTests-1759236468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87c3637c-a631-47e0-8641-e88f7e8100ca" returned: 0 in 0.382s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ad3848ae-4661-450a-9d38-92ba64d8dc34 tempest-ProjectReaderTests-1759236468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87c3637c-a631-47e0-8641-e88f7e8100ca {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:11 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87c3637c-a631-47e0-8641-e88f7e8100ca Jul 24 09:55:11 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:11 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d4106579-dee0-474e-9809-72587c2620ac tempest-ProjectReaderTests-1349320014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481" returned: 0 in 0.360s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d4106579-dee0-474e-9809-72587c2620ac tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:11 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481 Jul 24 09:55:11 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a0e2c09d-27be-44f2-a1b2-76d90cb320e6 tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a0e2c09d-27be-44f2-a1b2-76d90cb320e6 tempest-ProjectMemberTests-949013298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-a0e2c09d-27be-44f2-a1b2-76d90cb320e6 tempest-ProjectMemberTests-949013298 None] Creating offline snapshot 30fba375-25e0-4e73-bdea-e45092d6f09c of volume f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abe16a3-a6a7-4bb9-b831-060793c8b340]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a0e2c09d-27be-44f2-a1b2-76d90cb320e6 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:12 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ad3848ae-4661-450a-9d38-92ba64d8dc34 tempest-ProjectReaderTests-1759236468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-87c3637c-a631-47e0-8641-e88f7e8100ca" returned: 0 in 0.291s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ad3848ae-4661-450a-9d38-92ba64d8dc34 tempest-ProjectReaderTests-1759236468 None] Lock "cinder-quobyte-87c3637c-a631-47e0-8641-e88f7e8100ca" released by "delete_volume" :: held 0.715s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:12 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e Jul 24 09:55:12 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-ad3848ae-4661-450a-9d38-92ba64d8dc34 tempest-ProjectReaderTests-1759236468 None] Created reservations ['0109ad6e-0486-4070-8adc-fd5e24233488', '0fa8bf63-90cc-4378-b3df-552da34733fd', '8883c01d-b205-4d7d-add6-8f337f13104d', 'a8a57020-5cb9-4b36-9cbe-d5b89f153a27'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:12 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d4106579-dee0-474e-9809-72587c2620ac tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-a3096f80-c98a-49dc-902a-8da865af7481" returned: 0 in 0.282s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d4106579-dee0-474e-9809-72587c2620ac tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-a3096f80-c98a-49dc-902a-8da865af7481" released by "delete_volume" :: held 0.707s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ad3848ae-4661-450a-9d38-92ba64d8dc34 tempest-ProjectReaderTests-1759236468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ad3848ae-4661-450a-9d38-92ba64d8dc34 tempest-ProjectReaderTests-1759236468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ad3848ae-4661-450a-9d38-92ba64d8dc34 tempest-ProjectReaderTests-1759236468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ad3848ae-4661-450a-9d38-92ba64d8dc34 tempest-ProjectReaderTests-1759236468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ad3848ae-4661-450a-9d38-92ba64d8dc34 tempest-ProjectReaderTests-1759236468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ad3848ae-4661-450a-9d38-92ba64d8dc34 tempest-ProjectReaderTests-1759236468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:12 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:55:12 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-d4106579-dee0-474e-9809-72587c2620ac tempest-ProjectReaderTests-1349320014 None] Created reservations ['0b89f9ef-6e57-433d-8095-bd745552126e', '8006b1c5-3468-42f5-9f72-26227eb9eb5c', '98addd74-f757-4073-8508-64c5aa7e53bc', '6b67c57f-491f-4167-a935-48d630c14bf0'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d4106579-dee0-474e-9809-72587c2620ac tempest-ProjectReaderTests-1349320014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d4106579-dee0-474e-9809-72587c2620ac tempest-ProjectReaderTests-1349320014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d4106579-dee0-474e-9809-72587c2620ac tempest-ProjectReaderTests-1349320014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d4106579-dee0-474e-9809-72587c2620ac tempest-ProjectReaderTests-1349320014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d4106579-dee0-474e-9809-72587c2620ac tempest-ProjectReaderTests-1349320014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d4106579-dee0-474e-9809-72587c2620ac tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:12 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:55:12 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:12 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a0e2c09d-27be-44f2-a1b2-76d90cb320e6 tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e" returned: 0 in 0.430s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a0e2c09d-27be-44f2-a1b2-76d90cb320e6 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.30fba375-25e0-4e73-bdea-e45092d6f09c 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:12 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.30fba375-25e0-4e73-bdea-e45092d6f09c 1G Jul 24 09:55:12 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:12 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ad3848ae-4661-450a-9d38-92ba64d8dc34 tempest-ProjectReaderTests-1759236468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.367s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-ad3848ae-4661-450a-9d38-92ba64d8dc34 tempest-ProjectReaderTests-1759236468 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:55:12 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-ad3848ae-4661-450a-9d38-92ba64d8dc34 tempest-ProjectReaderTests-1759236468 None] Deleted volume successfully. Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-ad3848ae-4661-450a-9d38-92ba64d8dc34 tempest-ProjectReaderTests-1759236468 None] Lock "cinder-87c3637c-a631-47e0-8641-e88f7e8100ca-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:12 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d4106579-dee0-474e-9809-72587c2620ac tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.402s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-d4106579-dee0-474e-9809-72587c2620ac tempest-ProjectReaderTests-1349320014 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:55:12 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d4106579-dee0-474e-9809-72587c2620ac tempest-ProjectReaderTests-1349320014 None] Deleted volume successfully. Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-d4106579-dee0-474e-9809-72587c2620ac tempest-ProjectReaderTests-1349320014 None] Lock "cinder-a3096f80-c98a-49dc-902a-8da865af7481-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:12 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a0e2c09d-27be-44f2-a1b2-76d90cb320e6 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.30fba375-25e0-4e73-bdea-e45092d6f09c 1G" returned: 0 in 0.566s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a0e2c09d-27be-44f2-a1b2-76d90cb320e6 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.30fba375-25e0-4e73-bdea-e45092d6f09c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:13 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.30fba375-25e0-4e73-bdea-e45092d6f09c Jul 24 09:55:13 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Flow 'volume_create_manager' (3bfb15e7-99df-4891-b684-e141a76b9ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8643371f-30f0-48e3-8c30-2e4ac3461b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:13 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8643371f-30f0-48e3-8c30-2e4ac3461b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1112296166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4a9957-505d-4cdc-8f88-e845dd173593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0438e97b33f347f2b744d041f07ab559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:13Z,use_quota=True,user_id='7941b54a126f4f50b1fb719af22e5a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5b1d0c-c7bc-4942-81a8-c8116d5fcf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5b1d0c-c7bc-4942-81a8-c8116d5fcf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d14044-7755-4672-9819-96fcb4728504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d14044-7755-4672-9819-96fcb4728504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed4a9957-505d-4cdc-8f88-e845dd173593', 'volume_name': 'volume-ed4a9957-505d-4cdc-8f88-e845dd173593', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10903d8-477a-46a6-8950-33955594db94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10903d8-477a-46a6-8950-33955594db94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f862fd2-7256-45b4-9ea2-98681f453d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:13 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Volume ed4a9957-505d-4cdc-8f88-e845dd173593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed4a9957-505d-4cdc-8f88-e845dd173593', 'volume_size': 1} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a0e2c09d-27be-44f2-a1b2-76d90cb320e6 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.30fba375-25e0-4e73-bdea-e45092d6f09c" returned: 0 in 0.354s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:13 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-a0e2c09d-27be-44f2-a1b2-76d90cb320e6 tempest-ProjectMemberTests-949013298 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.30fba375-25e0-4e73-bdea-e45092d6f09c is being set with open permissions: ugo+rw Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a0e2c09d-27be-44f2-a1b2-76d90cb320e6 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.30fba375-25e0-4e73-bdea-e45092d6f09c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:55:13 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.30fba375-25e0-4e73-bdea-e45092d6f09c Jul 24 09:55:13 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Flow 'volume_create_manager' (78439664-d550-4ab5-be0f-4eaee81f838a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85eb344-dfda-4653-97aa-4f8af4f289e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85eb344-dfda-4653-97aa-4f8af4f289e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1491437364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=840adcc7-5290-4f50-a601-0ff1a7330c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f173c6fb30484362a9b610658bd4c1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:13Z,use_quota=True,user_id='970ee2f61cec4e3b8aa7dbb96c257be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de2ddd3-2e07-41e6-97dc-fc05e04230be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de2ddd3-2e07-41e6-97dc-fc05e04230be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88999bf2-1a8c-4219-ad99-85c96bbe8dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88999bf2-1a8c-4219-ad99-85c96bbe8dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '840adcc7-5290-4f50-a601-0ff1a7330c6e', 'volume_name': 'volume-840adcc7-5290-4f50-a601-0ff1a7330c6e', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1df1d39-900b-4a4f-bf01-01ce10447b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1df1d39-900b-4a4f-bf01-01ce10447b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3e53dd-ca45-4309-90cf-20b48aa7cf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:13 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Volume 840adcc7-5290-4f50-a601-0ff1a7330c6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-840adcc7-5290-4f50-a601-0ff1a7330c6e', 'volume_size': 1} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:13 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a0e2c09d-27be-44f2-a1b2-76d90cb320e6 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.30fba375-25e0-4e73-bdea-e45092d6f09c" returned: 0 in 0.251s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a0e2c09d-27be-44f2-a1b2-76d90cb320e6 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:13 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.info Jul 24 09:55:13 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:13 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a0e2c09d-27be-44f2-a1b2-76d90cb320e6 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.info" returned: 0 in 0.252s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:13 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-a0e2c09d-27be-44f2-a1b2-76d90cb320e6 tempest-ProjectMemberTests-949013298 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.info is being set with open permissions: ugo+rw Jul 24 09:55:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a0e2c09d-27be-44f2-a1b2-76d90cb320e6 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:13 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.info Jul 24 09:55:13 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:14 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a0e2c09d-27be-44f2-a1b2-76d90cb320e6 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.info" returned: 0 in 0.254s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a0e2c09d-27be-44f2-a1b2-76d90cb320e6 tempest-ProjectMemberTests-949013298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.809s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1112296166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4a9957-505d-4cdc-8f88-e845dd173593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0438e97b33f347f2b744d041f07ab559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:13Z,use_quota=True,user_id='7941b54a126f4f50b1fb719af22e5a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Creating volume ed4a9957-505d-4cdc-8f88-e845dd173593 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:55:14 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ed4a9957-505d-4cdc-8f88-e845dd173593 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:14 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ed4a9957-505d-4cdc-8f88-e845dd173593 1073741824 Jul 24 09:55:14 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:14 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-a0e2c09d-27be-44f2-a1b2-76d90cb320e6 tempest-ProjectMemberTests-949013298 None] Create snapshot completed successfully Jul 24 09:55:14 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ed4a9957-505d-4cdc-8f88-e845dd173593 1073741824" returned: 0 in 0.402s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ed4a9957-505d-4cdc-8f88-e845dd173593 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:14 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ed4a9957-505d-4cdc-8f88-e845dd173593 Jul 24 09:55:14 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:14 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ed4a9957-505d-4cdc-8f88-e845dd173593" returned: 0 in 0.243s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.387s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1491437364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=840adcc7-5290-4f50-a601-0ff1a7330c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f173c6fb30484362a9b610658bd4c1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:13Z,use_quota=True,user_id='970ee2f61cec4e3b8aa7dbb96c257be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Creating volume 840adcc7-5290-4f50-a601-0ff1a7330c6e {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:55:14 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f862fd2-7256-45b4-9ea2-98681f453d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed4a9957-505d-4cdc-8f88-e845dd173593', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:14 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e 1073741824 Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815b9453-90a5-4e86-b0fe-9999eca76384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:14 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:14 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Volume volume-ed4a9957-505d-4cdc-8f88-e845dd173593 (ed4a9957-505d-4cdc-8f88-e845dd173593): created successfully Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815b9453-90a5-4e86-b0fe-9999eca76384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:14 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Flow 'volume_create_manager' (3bfb15e7-99df-4891-b684-e141a76b9ca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:14 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-da3e3346-31e7-49be-98f6-8bc282eef896 tempest-ProjectReaderTests-1759236468 None] Created volume successfully. Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-30fba375-25e0-4e73-bdea-e45092d6f09c-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:15 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:55:15 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] Lock "cinder-30fba375-25e0-4e73-bdea-e45092d6f09c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-30fba375-25e0-4e73-bdea-e45092d6f09c" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-30fba375-25e0-4e73-bdea-e45092d6f09c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] Deleting offline snapshot 30fba375-25e0-4e73-bdea-e45092d6f09c of volume f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] snapshot_file for this snap is: volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.30fba375-25e0-4e73-bdea-e45092d6f09c {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb86389-88e9-4a92-92e3-3381ea612b73]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.30fba375-25e0-4e73-bdea-e45092d6f09c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a9961577-b1ca-439a-9538-87c1bb6561cf tempest-ProjectReaderTests-1759236468 None] Acquiring lock "cinder-ed4a9957-505d-4cdc-8f88-e845dd173593-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a9961577-b1ca-439a-9538-87c1bb6561cf tempest-ProjectReaderTests-1759236468 None] Lock "cinder-ed4a9957-505d-4cdc-8f88-e845dd173593-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a9961577-b1ca-439a-9538-87c1bb6561cf tempest-ProjectReaderTests-1759236468 None] Acquiring lock "cinder-quobyte-ed4a9957-505d-4cdc-8f88-e845dd173593" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a9961577-b1ca-439a-9538-87c1bb6561cf tempest-ProjectReaderTests-1759236468 None] Lock "cinder-quobyte-ed4a9957-505d-4cdc-8f88-e845dd173593" acquired by "delete_volume" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:15 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:15 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.30fba375-25e0-4e73-bdea-e45092d6f09c Jul 24 09:55:15 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.340s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:55:15 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 28 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e 1073741824" returned: 0 in 0.582s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2fb432-8edb-4b47-8188-de3f56f7b301]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a9961577-b1ca-439a-9538-87c1bb6561cf tempest-ProjectReaderTests-1759236468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ed4a9957-505d-4cdc-8f88-e845dd173593 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:15 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e Jul 24 09:55:15 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:15 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ed4a9957-505d-4cdc-8f88-e845dd173593 Jul 24 09:55:15 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:15 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.30fba375-25e0-4e73-bdea-e45092d6f09c" returned: 0 in 0.407s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b52aa8-9af0-434a-adb0-fd7566f8a7db]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:15 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e" returned: 0 in 0.266s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3e53dd-ca45-4309-90cf-20b48aa7cf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-840adcc7-5290-4f50-a601-0ff1a7330c6e', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb687d32-60f3-4765-ae69-c9e6f174e72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:15 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Volume volume-840adcc7-5290-4f50-a601-0ff1a7330c6e (840adcc7-5290-4f50-a601-0ff1a7330c6e): created successfully Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb687d32-60f3-4765-ae69-c9e6f174e72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Flow 'volume_create_manager' (78439664-d550-4ab5-be0f-4eaee81f838a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:15 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e Jul 24 09:55:15 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:15 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-9a551642-7893-4312-8dfd-0e4b01bf6573 tempest-ProjectReaderTests-1349320014 None] Created volume successfully. Jul 24 09:55:15 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a9961577-b1ca-439a-9538-87c1bb6561cf tempest-ProjectReaderTests-1759236468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ed4a9957-505d-4cdc-8f88-e845dd173593" returned: 0 in 0.394s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a9961577-b1ca-439a-9538-87c1bb6561cf tempest-ProjectReaderTests-1759236468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ed4a9957-505d-4cdc-8f88-e845dd173593 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:15 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ed4a9957-505d-4cdc-8f88-e845dd173593 Jul 24 09:55:15 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:16 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e" returned: 0 in 0.362s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.30fba375-25e0-4e73-bdea-e45092d6f09c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:16 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:16 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.30fba375-25e0-4e73-bdea-e45092d6f09c Jul 24 09:55:16 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a9961577-b1ca-439a-9538-87c1bb6561cf tempest-ProjectReaderTests-1759236468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-ed4a9957-505d-4cdc-8f88-e845dd173593" returned: 0 in 0.254s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a9961577-b1ca-439a-9538-87c1bb6561cf tempest-ProjectReaderTests-1759236468 None] Lock "cinder-quobyte-ed4a9957-505d-4cdc-8f88-e845dd173593" released by "delete_volume" :: held 0.703s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-a9961577-b1ca-439a-9538-87c1bb6561cf tempest-ProjectReaderTests-1759236468 None] Created reservations ['57591c6a-2ac1-4d98-8da0-e0411b04ca81', 'c0bd6e7b-e3db-4a69-9911-9687d3523f17', '3f794793-75a5-4bd1-886d-f1363e9a3744', '781867b0-bda6-46a0-b304-6303e8d927d7'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a9961577-b1ca-439a-9538-87c1bb6561cf tempest-ProjectReaderTests-1759236468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a9961577-b1ca-439a-9538-87c1bb6561cf tempest-ProjectReaderTests-1759236468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a9961577-b1ca-439a-9538-87c1bb6561cf tempest-ProjectReaderTests-1759236468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a9961577-b1ca-439a-9538-87c1bb6561cf tempest-ProjectReaderTests-1759236468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a9961577-b1ca-439a-9538-87c1bb6561cf tempest-ProjectReaderTests-1759236468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a9961577-b1ca-439a-9538-87c1bb6561cf tempest-ProjectReaderTests-1759236468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:16 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:55:16 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:16 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.30fba375-25e0-4e73-bdea-e45092d6f09c" returned: 0 in 0.448s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.30fba375-25e0-4e73-bdea-e45092d6f09c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:16 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.30fba375-25e0-4e73-bdea-e45092d6f09c Jul 24 09:55:16 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:16 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a9961577-b1ca-439a-9538-87c1bb6561cf tempest-ProjectReaderTests-1759236468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.357s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-a9961577-b1ca-439a-9538-87c1bb6561cf tempest-ProjectReaderTests-1759236468 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:55:16 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-a9961577-b1ca-439a-9538-87c1bb6561cf tempest-ProjectReaderTests-1759236468 None] Deleted volume successfully. Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e33a64f6-8d01-47bd-9355-5e096fb64ad5 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e33a64f6-8d01-47bd-9355-5e096fb64ad5 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a9961577-b1ca-439a-9538-87c1bb6561cf tempest-ProjectReaderTests-1759236468 None] Lock "cinder-ed4a9957-505d-4cdc-8f88-e845dd173593-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-e33a64f6-8d01-47bd-9355-5e096fb64ad5 tempest-ProjectReaderTests-1349320014 None] Creating offline snapshot 583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c of volume 840adcc7-5290-4f50-a601-0ff1a7330c6e {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c0c18d-a084-4015-b86e-ef7535a2f5a9]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e33a64f6-8d01-47bd-9355-5e096fb64ad5 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:16 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e Jul 24 09:55:16 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:16 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e.30fba375-25e0-4e73-bdea-e45092d6f09c" returned: 0 in 0.320s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-30fba375-25e0-4e73-bdea-e45092d6f09c" released by "_delete_snapshot" :: held 1.667s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e" released by "delete_snapshot" :: held 1.708s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:16 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] Created reservations ['1d0676af-fb6f-4b84-aa9a-680b81729ef3', '72b8870c-8e22-425d-bc8a-e9385bc44762', 'fa553d19-3a55-4170-beac-1491fb22a3c4', '1a799966-c0e1-41c1-b40d-8af3ec4455f6'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:17 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] Delete snapshot completed successfully. Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-54f4477a-cee7-480f-9ff1-90a647ee82ae tempest-ProjectMemberTests-949013298 None] Lock "cinder-30fba375-25e0-4e73-bdea-e45092d6f09c-delete_snapshot" released by "delete_snapshot" :: held 1.882s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:55:17 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Flow 'volume_create_manager' (8ec184cd-dcb8-4eb8-899e-6273fe6238aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb534ffa-a9c3-4957-aab8-c7f96462c5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e33a64f6-8d01-47bd-9355-5e096fb64ad5 tempest-ProjectReaderTests-1349320014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e" returned: 0 in 0.413s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e33a64f6-8d01-47bd-9355-5e096fb64ad5 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb534ffa-a9c3-4957-aab8-c7f96462c5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1488992055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d11a969-984b-433c-9c44-4c5b038688c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0438e97b33f347f2b744d041f07ab559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:17Z,use_quota=True,user_id='7941b54a126f4f50b1fb719af22e5a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:17 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c 1G Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3dfafd1-172e-48d5-8839-21074e168ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:17 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3dfafd1-172e-48d5-8839-21074e168ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20517f8-fcf5-453a-92bf-e7aa1643ef5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20517f8-fcf5-453a-92bf-e7aa1643ef5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d11a969-984b-433c-9c44-4c5b038688c1', 'volume_name': 'volume-2d11a969-984b-433c-9c44-4c5b038688c1', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a395dc-5716-44c7-8a60-cfdf2265354e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a395dc-5716-44c7-8a60-cfdf2265354e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b6ad45-5204-404b-89e0-fad407ee577b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:17 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Volume 2d11a969-984b-433c-9c44-4c5b038688c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d11a969-984b-433c-9c44-4c5b038688c1', 'volume_size': 1} Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c3bf6a26-f1fd-4b22-a02c-9e60175ee2af tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c3bf6a26-f1fd-4b22-a02c-9e60175ee2af tempest-ProjectMemberTests-949013298 None] Lock "cinder-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c3bf6a26-f1fd-4b22-a02c-9e60175ee2af tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c3bf6a26-f1fd-4b22-a02c-9e60175ee2af tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e" acquired by "delete_volume" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f235ea80-9a3d-411a-8418-6a903def52a2]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3bf6a26-f1fd-4b22-a02c-9e60175ee2af tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:17 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e33a64f6-8d01-47bd-9355-5e096fb64ad5 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c 1G" returned: 0 in 0.443s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e33a64f6-8d01-47bd-9355-5e096fb64ad5 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-840adcc7-5290-4f50-a601-0ff1a7330c6e -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:17 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-840adcc7-5290-4f50-a601-0ff1a7330c6e -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c Jul 24 09:55:17 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:17 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e Jul 24 09:55:17 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:17 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e33a64f6-8d01-47bd-9355-5e096fb64ad5 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-840adcc7-5290-4f50-a601-0ff1a7330c6e -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c" returned: 0 in 0.285s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:17 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-e33a64f6-8d01-47bd-9355-5e096fb64ad5 tempest-ProjectReaderTests-1349320014 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c is being set with open permissions: ugo+rw Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e33a64f6-8d01-47bd-9355-5e096fb64ad5 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:17 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3bf6a26-f1fd-4b22-a02c-9e60175ee2af tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e" returned: 0 in 0.369s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:17 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3bf6a26-f1fd-4b22-a02c-9e60175ee2af tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:17 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c Jul 24 09:55:17 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:17 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e Jul 24 09:55:17 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:18 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e33a64f6-8d01-47bd-9355-5e096fb64ad5 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c" returned: 0 in 0.249s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:18 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3bf6a26-f1fd-4b22-a02c-9e60175ee2af tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e" returned: 0 in 0.249s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e33a64f6-8d01-47bd-9355-5e096fb64ad5 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c3bf6a26-f1fd-4b22-a02c-9e60175ee2af tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e" released by "delete_volume" :: held 0.693s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:18 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.info Jul 24 09:55:18 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-c3bf6a26-f1fd-4b22-a02c-9e60175ee2af tempest-ProjectMemberTests-949013298 None] Created reservations ['757d9832-d317-49d6-b54d-f277f273cb22', '1f8a67af-45b6-4b8a-9694-2b2e1b09628e', 'f87f40a0-43db-448b-b6f0-117ca373c303', 'e25c57ee-dffb-4d7c-b654-aabe29afd887'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c3bf6a26-f1fd-4b22-a02c-9e60175ee2af tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c3bf6a26-f1fd-4b22-a02c-9e60175ee2af tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c3bf6a26-f1fd-4b22-a02c-9e60175ee2af tempest-ProjectMemberTests-949013298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c3bf6a26-f1fd-4b22-a02c-9e60175ee2af tempest-ProjectMemberTests-949013298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c3bf6a26-f1fd-4b22-a02c-9e60175ee2af tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3bf6a26-f1fd-4b22-a02c-9e60175ee2af tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:18 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:55:18 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:18 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e33a64f6-8d01-47bd-9355-5e096fb64ad5 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.info" returned: 0 in 0.261s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:18 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-e33a64f6-8d01-47bd-9355-5e096fb64ad5 tempest-ProjectReaderTests-1349320014 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.info is being set with open permissions: ugo+rw Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e33a64f6-8d01-47bd-9355-5e096fb64ad5 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:18 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.info Jul 24 09:55:18 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:18 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c3bf6a26-f1fd-4b22-a02c-9e60175ee2af tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.265s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-c3bf6a26-f1fd-4b22-a02c-9e60175ee2af tempest-ProjectMemberTests-949013298 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:55:18 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c3bf6a26-f1fd-4b22-a02c-9e60175ee2af tempest-ProjectMemberTests-949013298 None] Deleted volume successfully. Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-c3bf6a26-f1fd-4b22-a02c-9e60175ee2af tempest-ProjectMemberTests-949013298 None] Lock "cinder-f2c6fedc-3fe3-4464-bd94-9f5ef9d1da3e-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:18 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e33a64f6-8d01-47bd-9355-5e096fb64ad5 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.info" returned: 0 in 0.260s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e33a64f6-8d01-47bd-9355-5e096fb64ad5 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.030s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.516s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1488992055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d11a969-984b-433c-9c44-4c5b038688c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0438e97b33f347f2b744d041f07ab559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:17Z,use_quota=True,user_id='7941b54a126f4f50b1fb719af22e5a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Creating volume 2d11a969-984b-433c-9c44-4c5b038688c1 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:55:18 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2d11a969-984b-433c-9c44-4c5b038688c1 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:18 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2d11a969-984b-433c-9c44-4c5b038688c1 1073741824 Jul 24 09:55:18 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:18 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e33a64f6-8d01-47bd-9355-5e096fb64ad5 tempest-ProjectReaderTests-1349320014 None] Create snapshot completed successfully Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Flow 'volume_create_manager' (2be8b01b-6b58-4bc7-b0f4-be1960d13c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb058d6-b570-492d-9d70-4d13de95a24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:18 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb058d6-b570-492d-9d70-4d13de95a24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2074311729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c632d2f-1b88-4467-b1a3-db8a064c302d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b587ba61104b63b86e5a657e21be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:19Z,use_quota=True,user_id='bb693ea0a87140e195a91cab5d5e34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a283885-0451-4f3d-ad93-e39ca7ca3807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a283885-0451-4f3d-ad93-e39ca7ca3807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f6303e-3c0a-4bef-9f71-fc40ab061d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f6303e-3c0a-4bef-9f71-fc40ab061d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c632d2f-1b88-4467-b1a3-db8a064c302d', 'volume_name': 'volume-3c632d2f-1b88-4467-b1a3-db8a064c302d', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d046d9d9-d22e-409e-ab2b-f5d7dccd20f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d046d9d9-d22e-409e-ab2b-f5d7dccd20f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7646802-37d4-4b0c-8a32-c2eebfa6c2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:19 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Volume 3c632d2f-1b88-4467-b1a3-db8a064c302d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c632d2f-1b88-4467-b1a3-db8a064c302d', 'volume_size': 1} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:19 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2d11a969-984b-433c-9c44-4c5b038688c1 1073741824" returned: 0 in 0.449s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2d11a969-984b-433c-9c44-4c5b038688c1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:19 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2d11a969-984b-433c-9c44-4c5b038688c1 Jul 24 09:55:19 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:19 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2d11a969-984b-433c-9c44-4c5b038688c1" returned: 0 in 0.241s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.318s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2074311729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c632d2f-1b88-4467-b1a3-db8a064c302d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b587ba61104b63b86e5a657e21be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:19Z,use_quota=True,user_id='bb693ea0a87140e195a91cab5d5e34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Creating volume 3c632d2f-1b88-4467-b1a3-db8a064c302d {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:55:19 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b6ad45-5204-404b-89e0-fad407ee577b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d11a969-984b-433c-9c44-4c5b038688c1', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:19 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d 1073741824 Jul 24 09:55:19 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81020a3a-ab11-4a05-bc23-a12e83b19d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:19 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Volume volume-2d11a969-984b-433c-9c44-4c5b038688c1 (2d11a969-984b-433c-9c44-4c5b038688c1): created successfully Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81020a3a-ab11-4a05-bc23-a12e83b19d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Flow 'volume_create_manager' (8ec184cd-dcb8-4eb8-899e-6273fe6238aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:19 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-02a91ac6-cc28-494a-9f6e-c4f345a40184 tempest-ProjectReaderTests-1759236468 None] Created volume successfully. Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] Lock "cinder-583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-quobyte-840adcc7-5290-4f50-a601-0ff1a7330c6e" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-840adcc7-5290-4f50-a601-0ff1a7330c6e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-quobyte-583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] Deleting offline snapshot 583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c of volume 840adcc7-5290-4f50-a601-0ff1a7330c6e {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:55:19 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] snapshot_file for this snap is: volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d 1073741824" returned: 0 in 0.465s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0af23ee-887d-4448-8b52-34c127836ae7]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:19 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:19 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d Jul 24 09:55:19 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:19 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c Jul 24 09:55:19 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:20 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d" returned: 0 in 0.248s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7646802-37d4-4b0c-8a32-c2eebfa6c2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c632d2f-1b88-4467-b1a3-db8a064c302d', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25a2553d-fcdc-42ad-9038-bfceda1ca66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:20 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Volume volume-3c632d2f-1b88-4467-b1a3-db8a064c302d (3c632d2f-1b88-4467-b1a3-db8a064c302d): created successfully Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25a2553d-fcdc-42ad-9038-bfceda1ca66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Flow 'volume_create_manager' (2be8b01b-6b58-4bc7-b0f4-be1960d13c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6f711881-8c28-41dc-b59d-2f903a6f68ce tempest-ProjectReaderTests-1759236468 None] Acquiring lock "cinder-2d11a969-984b-433c-9c44-4c5b038688c1-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:20 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-c6a349b6-1489-4292-8730-f45c63c92854 tempest-ProjectMemberTests-949013298 None] Created volume successfully. Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6f711881-8c28-41dc-b59d-2f903a6f68ce tempest-ProjectReaderTests-1759236468 None] Lock "cinder-2d11a969-984b-433c-9c44-4c5b038688c1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:20 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6f711881-8c28-41dc-b59d-2f903a6f68ce tempest-ProjectReaderTests-1759236468 None] Acquiring lock "cinder-quobyte-2d11a969-984b-433c-9c44-4c5b038688c1" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c" returned: 0 in 0.410s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-840adcc7-5290-4f50-a601-0ff1a7330c6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6f711881-8c28-41dc-b59d-2f903a6f68ce tempest-ProjectReaderTests-1759236468 None] Lock "cinder-quobyte-2d11a969-984b-433c-9c44-4c5b038688c1" acquired by "delete_volume" :: waited 0.035s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1e8259-f9e4-467a-a233-5c7a4fa6ca43]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad05c944-257e-4bc7-8fd3-af20ef519a0c]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6f711881-8c28-41dc-b59d-2f903a6f68ce tempest-ProjectReaderTests-1759236468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2d11a969-984b-433c-9c44-4c5b038688c1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:20 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e Jul 24 09:55:20 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:20 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2d11a969-984b-433c-9c44-4c5b038688c1 Jul 24 09:55:20 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:20 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e" returned: 0 in 0.356s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:20 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6f711881-8c28-41dc-b59d-2f903a6f68ce tempest-ProjectReaderTests-1759236468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2d11a969-984b-433c-9c44-4c5b038688c1" returned: 0 in 0.354s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6f711881-8c28-41dc-b59d-2f903a6f68ce tempest-ProjectReaderTests-1759236468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2d11a969-984b-433c-9c44-4c5b038688c1 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:20 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c Jul 24 09:55:20 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:20 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2d11a969-984b-433c-9c44-4c5b038688c1 Jul 24 09:55:20 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:20 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6f711881-8c28-41dc-b59d-2f903a6f68ce tempest-ProjectReaderTests-1759236468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-2d11a969-984b-433c-9c44-4c5b038688c1" returned: 0 in 0.247s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6f711881-8c28-41dc-b59d-2f903a6f68ce tempest-ProjectReaderTests-1759236468 None] Lock "cinder-quobyte-2d11a969-984b-433c-9c44-4c5b038688c1" released by "delete_volume" :: held 0.647s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:20 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-6f711881-8c28-41dc-b59d-2f903a6f68ce tempest-ProjectReaderTests-1759236468 None] Created reservations ['7811ad1e-3a29-4ac1-a1ec-937258752896', 'bfbb4ef5-fe3a-43df-a383-a10567a0a48b', '397c14b0-a040-4276-84ff-593104307fab', 'f0008ef3-a7d2-4783-a21b-d75028e474b8'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:21 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c" returned: 0 in 0.350s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:21 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c Jul 24 09:55:21 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6f711881-8c28-41dc-b59d-2f903a6f68ce tempest-ProjectReaderTests-1759236468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6f711881-8c28-41dc-b59d-2f903a6f68ce tempest-ProjectReaderTests-1759236468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6f711881-8c28-41dc-b59d-2f903a6f68ce tempest-ProjectReaderTests-1759236468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6f711881-8c28-41dc-b59d-2f903a6f68ce tempest-ProjectReaderTests-1759236468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6f711881-8c28-41dc-b59d-2f903a6f68ce tempest-ProjectReaderTests-1759236468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6f711881-8c28-41dc-b59d-2f903a6f68ce tempest-ProjectReaderTests-1759236468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:21 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:55:21 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7d5efeb7-5e5f-441f-9c0b-9a8b6177d814 tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7d5efeb7-5e5f-441f-9c0b-9a8b6177d814 tempest-ProjectMemberTests-949013298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-7d5efeb7-5e5f-441f-9c0b-9a8b6177d814 tempest-ProjectMemberTests-949013298 None] Creating offline snapshot 6f489598-a493-41e1-9df1-da368ea04d4a of volume 3c632d2f-1b88-4467-b1a3-db8a064c302d {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ab79bb-9ccc-4d33-96fd-d2e602ffa016]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7d5efeb7-5e5f-441f-9c0b-9a8b6177d814 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:21 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e.583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c" returned: 0 in 0.284s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c" released by "_delete_snapshot" :: held 1.534s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-840adcc7-5290-4f50-a601-0ff1a7330c6e" released by "delete_snapshot" :: held 1.560s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:21 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6f711881-8c28-41dc-b59d-2f903a6f68ce tempest-ProjectReaderTests-1759236468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.286s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6f711881-8c28-41dc-b59d-2f903a6f68ce tempest-ProjectReaderTests-1759236468 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:55:21 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d Jul 24 09:55:21 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:21 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-6f711881-8c28-41dc-b59d-2f903a6f68ce tempest-ProjectReaderTests-1759236468 None] Deleted volume successfully. Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-6f711881-8c28-41dc-b59d-2f903a6f68ce tempest-ProjectReaderTests-1759236468 None] Lock "cinder-2d11a969-984b-433c-9c44-4c5b038688c1-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] Created reservations ['79a229d5-6bbc-4e14-8de2-01a36008ef99', '39ba434c-9a48-4d33-837e-874e177ae65b', '300453c0-56bf-4179-9e2b-cbea527b4a16', '93a49efd-34e2-4a21-9979-793a52952a9b'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:21 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] Delete snapshot completed successfully. Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a57602e4-8291-4529-8f73-8795f3275b4b tempest-ProjectReaderTests-1349320014 None] Lock "cinder-583cb35d-1bfa-44b3-b1f5-fd5dcf8d807c-delete_snapshot" released by "delete_snapshot" :: held 1.737s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:21 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7d5efeb7-5e5f-441f-9c0b-9a8b6177d814 tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d" returned: 0 in 0.410s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7d5efeb7-5e5f-441f-9c0b-9a8b6177d814 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.6f489598-a493-41e1-9df1-da368ea04d4a 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:21 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.6f489598-a493-41e1-9df1-da368ea04d4a 1G Jul 24 09:55:21 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cdeaced3-536f-4720-9ebc-440723d68c49 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-840adcc7-5290-4f50-a601-0ff1a7330c6e-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:21 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cdeaced3-536f-4720-9ebc-440723d68c49 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-840adcc7-5290-4f50-a601-0ff1a7330c6e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cdeaced3-536f-4720-9ebc-440723d68c49 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-quobyte-840adcc7-5290-4f50-a601-0ff1a7330c6e" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cdeaced3-536f-4720-9ebc-440723d68c49 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-840adcc7-5290-4f50-a601-0ff1a7330c6e" acquired by "delete_volume" :: waited 0.015s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2b1487-7c4e-455a-899c-51572ae4aaef]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdeaced3-536f-4720-9ebc-440723d68c49 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:22 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7d5efeb7-5e5f-441f-9c0b-9a8b6177d814 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.6f489598-a493-41e1-9df1-da368ea04d4a 1G" returned: 0 in 0.460s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7d5efeb7-5e5f-441f-9c0b-9a8b6177d814 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c632d2f-1b88-4467-b1a3-db8a064c302d -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.6f489598-a493-41e1-9df1-da368ea04d4a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:22 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c632d2f-1b88-4467-b1a3-db8a064c302d -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.6f489598-a493-41e1-9df1-da368ea04d4a Jul 24 09:55:22 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:22 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e Jul 24 09:55:22 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:22 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:22 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7d5efeb7-5e5f-441f-9c0b-9a8b6177d814 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c632d2f-1b88-4467-b1a3-db8a064c302d -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.6f489598-a493-41e1-9df1-da368ea04d4a" returned: 0 in 0.356s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdeaced3-536f-4720-9ebc-440723d68c49 tempest-ProjectReaderTests-1349320014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e" returned: 0 in 0.407s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:22 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-7d5efeb7-5e5f-441f-9c0b-9a8b6177d814 tempest-ProjectMemberTests-949013298 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.6f489598-a493-41e1-9df1-da368ea04d4a is being set with open permissions: ugo+rw Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7d5efeb7-5e5f-441f-9c0b-9a8b6177d814 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.6f489598-a493-41e1-9df1-da368ea04d4a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdeaced3-536f-4720-9ebc-440723d68c49 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:22 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.6f489598-a493-41e1-9df1-da368ea04d4a Jul 24 09:55:22 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:22 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e Jul 24 09:55:22 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:22 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7d5efeb7-5e5f-441f-9c0b-9a8b6177d814 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.6f489598-a493-41e1-9df1-da368ea04d4a" returned: 0 in 0.259s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:22 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdeaced3-536f-4720-9ebc-440723d68c49 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-840adcc7-5290-4f50-a601-0ff1a7330c6e" returned: 0 in 0.256s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cdeaced3-536f-4720-9ebc-440723d68c49 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-840adcc7-5290-4f50-a601-0ff1a7330c6e" released by "delete_volume" :: held 0.740s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7d5efeb7-5e5f-441f-9c0b-9a8b6177d814 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:22 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.info Jul 24 09:55:22 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-cdeaced3-536f-4720-9ebc-440723d68c49 tempest-ProjectReaderTests-1349320014 None] Created reservations ['7f534e53-7764-4f27-ae97-37848743a04b', '1639312e-dfb6-4110-b85c-67ac152b6914', 'a467845f-f97f-409b-a385-84e31d1bb921', '00eda476-f8ce-4e1f-81eb-646577736281'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cdeaced3-536f-4720-9ebc-440723d68c49 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cdeaced3-536f-4720-9ebc-440723d68c49 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cdeaced3-536f-4720-9ebc-440723d68c49 tempest-ProjectReaderTests-1349320014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-cdeaced3-536f-4720-9ebc-440723d68c49 tempest-ProjectReaderTests-1349320014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-cdeaced3-536f-4720-9ebc-440723d68c49 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:22 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdeaced3-536f-4720-9ebc-440723d68c49 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:22 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:55:22 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:23 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7d5efeb7-5e5f-441f-9c0b-9a8b6177d814 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.info" returned: 0 in 0.312s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:23 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-7d5efeb7-5e5f-441f-9c0b-9a8b6177d814 tempest-ProjectMemberTests-949013298 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.info is being set with open permissions: ugo+rw Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7d5efeb7-5e5f-441f-9c0b-9a8b6177d814 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:23 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.info Jul 24 09:55:23 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:23 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-cdeaced3-536f-4720-9ebc-440723d68c49 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.339s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-cdeaced3-536f-4720-9ebc-440723d68c49 tempest-ProjectReaderTests-1349320014 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:55:23 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-cdeaced3-536f-4720-9ebc-440723d68c49 tempest-ProjectReaderTests-1349320014 None] Deleted volume successfully. Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-cdeaced3-536f-4720-9ebc-440723d68c49 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-840adcc7-5290-4f50-a601-0ff1a7330c6e-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:23 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7d5efeb7-5e5f-441f-9c0b-9a8b6177d814 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.info" returned: 0 in 0.302s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-7d5efeb7-5e5f-441f-9c0b-9a8b6177d814 tempest-ProjectMemberTests-949013298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.214s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:23 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-7d5efeb7-5e5f-441f-9c0b-9a8b6177d814 tempest-ProjectMemberTests-949013298 None] Create snapshot completed successfully Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Flow 'volume_create_manager' (77aad3af-de4b-42a8-a3d0-6ed747d2fc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a70fb9-a67b-4ae8-91f2-6e851ed3ac23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a70fb9-a67b-4ae8-91f2-6e851ed3ac23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-939118357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9472b508-638d-4ceb-854b-b75737bac69c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f173c6fb30484362a9b610658bd4c1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:24Z,use_quota=True,user_id='970ee2f61cec4e3b8aa7dbb96c257be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872ca59e-b637-45a5-93d0-2baedbe0d1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872ca59e-b637-45a5-93d0-2baedbe0d1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c873968-0e44-4e33-a464-cebe3759ca48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c873968-0e44-4e33-a464-cebe3759ca48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9472b508-638d-4ceb-854b-b75737bac69c', 'volume_name': 'volume-9472b508-638d-4ceb-854b-b75737bac69c', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f3409d7-2be2-4410-9ea4-1a64e34eed47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f3409d7-2be2-4410-9ea4-1a64e34eed47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119052e7-14ab-42cd-9ae2-fcafc7a6b995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:23 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Volume 9472b508-638d-4ceb-854b-b75737bac69c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9472b508-638d-4ceb-854b-b75737bac69c', 'volume_size': 1} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-939118357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9472b508-638d-4ceb-854b-b75737bac69c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f173c6fb30484362a9b610658bd4c1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:24Z,use_quota=True,user_id='970ee2f61cec4e3b8aa7dbb96c257be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Creating volume 9472b508-638d-4ceb-854b-b75737bac69c {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:55:23 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:55:23 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:23 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c 1073741824 Jul 24 09:55:23 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:24 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c 1073741824" returned: 0 in 0.404s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:24 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c Jul 24 09:55:24 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-6f489598-a493-41e1-9df1-da368ea04d4a-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] Lock "cinder-6f489598-a493-41e1-9df1-da368ea04d4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-3c632d2f-1b88-4467-b1a3-db8a064c302d" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:24 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-3c632d2f-1b88-4467-b1a3-db8a064c302d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-6f489598-a493-41e1-9df1-da368ea04d4a" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c" returned: 0 in 0.287s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119052e7-14ab-42cd-9ae2-fcafc7a6b995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9472b508-638d-4ceb-854b-b75737bac69c', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc951a5-366d-4ba2-b760-e309fee9199a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-6f489598-a493-41e1-9df1-da368ea04d4a" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] Deleting offline snapshot 6f489598-a493-41e1-9df1-da368ea04d4a of volume 3c632d2f-1b88-4467-b1a3-db8a064c302d {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] snapshot_file for this snap is: volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.6f489598-a493-41e1-9df1-da368ea04d4a {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[09804611-2d91-4f7f-ac8b-bf60ea1ee7ad]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.6f489598-a493-41e1-9df1-da368ea04d4a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:24 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Volume volume-9472b508-638d-4ceb-854b-b75737bac69c (9472b508-638d-4ceb-854b-b75737bac69c): created successfully Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc951a5-366d-4ba2-b760-e309fee9199a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Flow 'volume_create_manager' (77aad3af-de4b-42a8-a3d0-6ed747d2fc35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:24 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-731be7fa-08e3-4a9b-ae25-5a56953f9f9b tempest-ProjectReaderTests-1349320014 None] Created volume successfully. Jul 24 09:55:24 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.6f489598-a493-41e1-9df1-da368ea04d4a Jul 24 09:55:24 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e48e25f3-c591-4eb3-bb82-e247d0c37de3 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e48e25f3-c591-4eb3-bb82-e247d0c37de3 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-e48e25f3-c591-4eb3-bb82-e247d0c37de3 tempest-ProjectReaderTests-1349320014 None] Creating offline snapshot 0fd0d8c3-eef1-42b5-b85d-832f99ad1082 of volume 9472b508-638d-4ceb-854b-b75737bac69c {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[70836dc4-d2ba-4f66-a3c3-201cc99132ee]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e48e25f3-c591-4eb3-bb82-e247d0c37de3 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:24 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.6f489598-a493-41e1-9df1-da368ea04d4a" returned: 0 in 0.437s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c632d2f-1b88-4467-b1a3-db8a064c302d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f37650-79cb-4103-b89c-470921b2b6ba]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:24 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:25 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c Jul 24 09:55:25 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:25 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d Jul 24 09:55:25 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:25 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e48e25f3-c591-4eb3-bb82-e247d0c37de3 tempest-ProjectReaderTests-1349320014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c" returned: 0 in 0.366s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e48e25f3-c591-4eb3-bb82-e247d0c37de3 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.0fd0d8c3-eef1-42b5-b85d-832f99ad1082 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:25 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.0fd0d8c3-eef1-42b5-b85d-832f99ad1082 1G Jul 24 09:55:25 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:25 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d" returned: 0 in 0.376s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.6f489598-a493-41e1-9df1-da368ea04d4a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:25 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.6f489598-a493-41e1-9df1-da368ea04d4a Jul 24 09:55:25 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:25 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e48e25f3-c591-4eb3-bb82-e247d0c37de3 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.0fd0d8c3-eef1-42b5-b85d-832f99ad1082 1G" returned: 0 in 0.416s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e48e25f3-c591-4eb3-bb82-e247d0c37de3 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9472b508-638d-4ceb-854b-b75737bac69c -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.0fd0d8c3-eef1-42b5-b85d-832f99ad1082 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:25 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9472b508-638d-4ceb-854b-b75737bac69c -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.0fd0d8c3-eef1-42b5-b85d-832f99ad1082 Jul 24 09:55:25 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:25 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.6f489598-a493-41e1-9df1-da368ea04d4a" returned: 0 in 0.371s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.6f489598-a493-41e1-9df1-da368ea04d4a {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:25 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.6f489598-a493-41e1-9df1-da368ea04d4a Jul 24 09:55:25 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:25 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e48e25f3-c591-4eb3-bb82-e247d0c37de3 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9472b508-638d-4ceb-854b-b75737bac69c -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.0fd0d8c3-eef1-42b5-b85d-832f99ad1082" returned: 0 in 0.298s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:25 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-e48e25f3-c591-4eb3-bb82-e247d0c37de3 tempest-ProjectReaderTests-1349320014 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.0fd0d8c3-eef1-42b5-b85d-832f99ad1082 is being set with open permissions: ugo+rw Jul 24 09:55:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e48e25f3-c591-4eb3-bb82-e247d0c37de3 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.0fd0d8c3-eef1-42b5-b85d-832f99ad1082 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:25 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:25 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d.6f489598-a493-41e1-9df1-da368ea04d4a" returned: 0 in 0.261s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:26 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.0fd0d8c3-eef1-42b5-b85d-832f99ad1082 Jul 24 09:55:26 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-6f489598-a493-41e1-9df1-da368ea04d4a" released by "_delete_snapshot" :: held 1.557s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-3c632d2f-1b88-4467-b1a3-db8a064c302d" released by "delete_snapshot" :: held 1.600s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] Created reservations ['6b10edfe-d2aa-4cc0-a2c3-ab817577526c', 'fe0c5bde-fc24-4e07-be16-65de48801bd9', '6c4de60a-2427-4732-8be6-f315ff92b7f1', '53254f7b-13f1-4045-bb6f-164417db2580'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:26 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] Delete snapshot completed successfully. Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-98331ae8-b553-41e5-9e39-b9b352f9d5bf tempest-ProjectMemberTests-949013298 None] Lock "cinder-6f489598-a493-41e1-9df1-da368ea04d4a-delete_snapshot" released by "delete_snapshot" :: held 1.741s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:26 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e48e25f3-c591-4eb3-bb82-e247d0c37de3 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.0fd0d8c3-eef1-42b5-b85d-832f99ad1082" returned: 0 in 0.247s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e48e25f3-c591-4eb3-bb82-e247d0c37de3 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:26 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.info Jul 24 09:55:26 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:26 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e48e25f3-c591-4eb3-bb82-e247d0c37de3 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.info" returned: 0 in 0.261s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:26 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-e48e25f3-c591-4eb3-bb82-e247d0c37de3 tempest-ProjectReaderTests-1349320014 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.info is being set with open permissions: ugo+rw Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e48e25f3-c591-4eb3-bb82-e247d0c37de3 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:26 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.info Jul 24 09:55:26 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-37b5ff9e-4bcc-4265-82e4-c9803c04aeb0 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-3c632d2f-1b88-4467-b1a3-db8a064c302d-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-37b5ff9e-4bcc-4265-82e4-c9803c04aeb0 tempest-ProjectMemberTests-949013298 None] Lock "cinder-3c632d2f-1b88-4467-b1a3-db8a064c302d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-37b5ff9e-4bcc-4265-82e4-c9803c04aeb0 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-3c632d2f-1b88-4467-b1a3-db8a064c302d" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-37b5ff9e-4bcc-4265-82e4-c9803c04aeb0 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-3c632d2f-1b88-4467-b1a3-db8a064c302d" acquired by "delete_volume" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[74260893-a4e2-472a-a420-3edf4baeaca9]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-37b5ff9e-4bcc-4265-82e4-c9803c04aeb0 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:26 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e48e25f3-c591-4eb3-bb82-e247d0c37de3 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.info" returned: 0 in 0.270s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e48e25f3-c591-4eb3-bb82-e247d0c37de3 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.933s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:26 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d Jul 24 09:55:26 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:26 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e48e25f3-c591-4eb3-bb82-e247d0c37de3 tempest-ProjectReaderTests-1349320014 None] Create snapshot completed successfully Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-0fd0d8c3-eef1-42b5-b85d-832f99ad1082-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-0fd0d8c3-eef1-42b5-b85d-832f99ad1082-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-quobyte-9472b508-638d-4ceb-854b-b75737bac69c" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-9472b508-638d-4ceb-854b-b75737bac69c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:26 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-quobyte-0fd0d8c3-eef1-42b5-b85d-832f99ad1082" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-0fd0d8c3-eef1-42b5-b85d-832f99ad1082" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] Deleting offline snapshot 0fd0d8c3-eef1-42b5-b85d-832f99ad1082 of volume 9472b508-638d-4ceb-854b-b75737bac69c {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] snapshot_file for this snap is: volume-9472b508-638d-4ceb-854b-b75737bac69c.0fd0d8c3-eef1-42b5-b85d-832f99ad1082 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63c74dd-81d8-4465-b228-bcedf9e2d554]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.0fd0d8c3-eef1-42b5-b85d-832f99ad1082 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:27 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-37b5ff9e-4bcc-4265-82e4-c9803c04aeb0 tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d" returned: 0 in 0.390s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-37b5ff9e-4bcc-4265-82e4-c9803c04aeb0 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:27 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d Jul 24 09:55:27 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:27 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.0fd0d8c3-eef1-42b5-b85d-832f99ad1082 Jul 24 09:55:27 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:27 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-37b5ff9e-4bcc-4265-82e4-c9803c04aeb0 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3c632d2f-1b88-4467-b1a3-db8a064c302d" returned: 0 in 0.252s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-37b5ff9e-4bcc-4265-82e4-c9803c04aeb0 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-3c632d2f-1b88-4467-b1a3-db8a064c302d" released by "delete_volume" :: held 0.703s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-37b5ff9e-4bcc-4265-82e4-c9803c04aeb0 tempest-ProjectMemberTests-949013298 None] Created reservations ['756a1932-96ce-4c7a-a1cb-916a63e6f7c0', '4428b990-3ce2-498f-9859-ee4d62f70058', '624edcf6-8552-4419-8aaa-6e12557d9c1c', '0b0bf5ee-333e-4cbf-9ec7-31a2425d3a1c'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:27 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.0fd0d8c3-eef1-42b5-b85d-832f99ad1082" returned: 0 in 0.381s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9472b508-638d-4ceb-854b-b75737bac69c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-37b5ff9e-4bcc-4265-82e4-c9803c04aeb0 tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-37b5ff9e-4bcc-4265-82e4-c9803c04aeb0 tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-37b5ff9e-4bcc-4265-82e4-c9803c04aeb0 tempest-ProjectMemberTests-949013298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-37b5ff9e-4bcc-4265-82e4-c9803c04aeb0 tempest-ProjectMemberTests-949013298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-37b5ff9e-4bcc-4265-82e4-c9803c04aeb0 tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-37b5ff9e-4bcc-4265-82e4-c9803c04aeb0 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb89a0c-1163-49dd-8c6e-98f3c5e80040]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:27 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:55:27 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:27 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c Jul 24 09:55:27 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:27 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-37b5ff9e-4bcc-4265-82e4-c9803c04aeb0 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.259s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-37b5ff9e-4bcc-4265-82e4-c9803c04aeb0 tempest-ProjectMemberTests-949013298 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:55:27 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-37b5ff9e-4bcc-4265-82e4-c9803c04aeb0 tempest-ProjectMemberTests-949013298 None] Deleted volume successfully. Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-37b5ff9e-4bcc-4265-82e4-c9803c04aeb0 tempest-ProjectMemberTests-949013298 None] Lock "cinder-3c632d2f-1b88-4467-b1a3-db8a064c302d-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:27 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c" returned: 0 in 0.384s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:27 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.0fd0d8c3-eef1-42b5-b85d-832f99ad1082 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:27 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.0fd0d8c3-eef1-42b5-b85d-832f99ad1082 Jul 24 09:55:27 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Flow 'volume_create_manager' (1dbe5c9f-deb1-4b7c-9f6b-b68173f24ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361d37f8-ab77-4097-865e-1e0d774c5111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:28 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.0fd0d8c3-eef1-42b5-b85d-832f99ad1082" returned: 0 in 0.359s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.0fd0d8c3-eef1-42b5-b85d-832f99ad1082 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361d37f8-ab77-4097-865e-1e0d774c5111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-482140245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efbd2a52-b7bd-42ce-a7f1-b406a55ebc42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b587ba61104b63b86e5a657e21be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:28Z,use_quota=True,user_id='bb693ea0a87140e195a91cab5d5e34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:28 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.0fd0d8c3-eef1-42b5-b85d-832f99ad1082 Jul 24 09:55:28 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c5e4dc-c0d5-4875-99c0-d00b35d4e6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c5e4dc-c0d5-4875-99c0-d00b35d4e6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779aa2d5-2aa7-4f5c-af32-f42fc6e5a94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779aa2d5-2aa7-4f5c-af32-f42fc6e5a94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efbd2a52-b7bd-42ce-a7f1-b406a55ebc42', 'volume_name': 'volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c70a51-dac7-4e16-9d01-6515610af14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c70a51-dac7-4e16-9d01-6515610af14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6c541f-f242-4e17-9f3b-f45a8474c7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:28 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Volume efbd2a52-b7bd-42ce-a7f1-b406a55ebc42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42', 'volume_size': 1} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-482140245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efbd2a52-b7bd-42ce-a7f1-b406a55ebc42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b587ba61104b63b86e5a657e21be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:28Z,use_quota=True,user_id='bb693ea0a87140e195a91cab5d5e34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Creating volume efbd2a52-b7bd-42ce-a7f1-b406a55ebc42 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:55:28 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:28 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42 1073741824 Jul 24 09:55:28 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:28 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c.0fd0d8c3-eef1-42b5-b85d-832f99ad1082" returned: 0 in 0.258s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-0fd0d8c3-eef1-42b5-b85d-832f99ad1082" released by "_delete_snapshot" :: held 1.495s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-9472b508-638d-4ceb-854b-b75737bac69c" released by "delete_snapshot" :: held 1.522s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] Created reservations ['f88803e0-2e9a-48d7-acb2-2356fa0e01c5', 'e3990e7e-daed-445b-9ca7-289afcf8b575', '855317b4-db50-410c-9e79-c73df487dd7e', 'c7dd73cc-0bf4-49ba-85c9-6b722a52dfac'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:28 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] Delete snapshot completed successfully. Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dcecf897-c1a1-43ab-8429-c4a07bd2b227 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-0fd0d8c3-eef1-42b5-b85d-832f99ad1082-delete_snapshot" released by "delete_snapshot" :: held 1.657s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:28 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42 1073741824" returned: 0 in 0.439s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:28 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:28 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42 Jul 24 09:55:28 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:28 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42" returned: 0 in 0.238s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6c541f-f242-4e17-9f3b-f45a8474c7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912e7555-95c2-4e4e-ae30-6cc80620b4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:29 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Volume volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42 (efbd2a52-b7bd-42ce-a7f1-b406a55ebc42): created successfully Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912e7555-95c2-4e4e-ae30-6cc80620b4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Flow 'volume_create_manager' (1dbe5c9f-deb1-4b7c-9f6b-b68173f24ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:29 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-24bceafb-53a9-4490-9bf8-ae37cd933c3e tempest-ProjectMemberTests-949013298 None] Created volume successfully. Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1dbd68d4-d8e2-418b-8760-886aa7520087 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-9472b508-638d-4ceb-854b-b75737bac69c-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1dbd68d4-d8e2-418b-8760-886aa7520087 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-9472b508-638d-4ceb-854b-b75737bac69c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1dbd68d4-d8e2-418b-8760-886aa7520087 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-quobyte-9472b508-638d-4ceb-854b-b75737bac69c" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1dbd68d4-d8e2-418b-8760-886aa7520087 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-9472b508-638d-4ceb-854b-b75737bac69c" acquired by "delete_volume" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d246bef-5ac2-4ba2-bb07-bcb2d1440790]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1dbd68d4-d8e2-418b-8760-886aa7520087 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8af53ec3-d5e1-4f7a-afa9-f12b028531ed tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8af53ec3-d5e1-4f7a-afa9-f12b028531ed tempest-ProjectMemberTests-949013298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-8af53ec3-d5e1-4f7a-afa9-f12b028531ed tempest-ProjectMemberTests-949013298 None] Creating offline snapshot 79662185-8304-4b6b-a469-484d848b6671 of volume efbd2a52-b7bd-42ce-a7f1-b406a55ebc42 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:55:29 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c Jul 24 09:55:29 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5516676-569d-4959-b7de-04b5e79a99d3]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8af53ec3-d5e1-4f7a-afa9-f12b028531ed tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:29 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42 Jul 24 09:55:29 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:29 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1dbd68d4-d8e2-418b-8760-886aa7520087 tempest-ProjectReaderTests-1349320014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c" returned: 0 in 0.368s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1dbd68d4-d8e2-418b-8760-886aa7520087 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:29 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c Jul 24 09:55:29 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:29 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8af53ec3-d5e1-4f7a-afa9-f12b028531ed tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42" returned: 0 in 0.357s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8af53ec3-d5e1-4f7a-afa9-f12b028531ed tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.79662185-8304-4b6b-a469-484d848b6671 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:29 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.79662185-8304-4b6b-a469-484d848b6671 1G Jul 24 09:55:29 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:29 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1dbd68d4-d8e2-418b-8760-886aa7520087 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9472b508-638d-4ceb-854b-b75737bac69c" returned: 0 in 0.263s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1dbd68d4-d8e2-418b-8760-886aa7520087 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-9472b508-638d-4ceb-854b-b75737bac69c" released by "delete_volume" :: held 0.697s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:29 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-1dbd68d4-d8e2-418b-8760-886aa7520087 tempest-ProjectReaderTests-1349320014 None] Created reservations ['4e93089d-ea46-4938-8c7c-b75fbc786d0e', '9ececba9-d862-40b7-9978-efecaf325a99', '664faea1-9cd6-4ced-8c30-86dc210b18a2', '987e3537-6563-40ce-b326-89347588edef'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1dbd68d4-d8e2-418b-8760-886aa7520087 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1dbd68d4-d8e2-418b-8760-886aa7520087 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1dbd68d4-d8e2-418b-8760-886aa7520087 tempest-ProjectReaderTests-1349320014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-1dbd68d4-d8e2-418b-8760-886aa7520087 tempest-ProjectReaderTests-1349320014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-1dbd68d4-d8e2-418b-8760-886aa7520087 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1dbd68d4-d8e2-418b-8760-886aa7520087 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:30 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:55:30 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:30 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8af53ec3-d5e1-4f7a-afa9-f12b028531ed tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.79662185-8304-4b6b-a469-484d848b6671 1G" returned: 0 in 0.426s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8af53ec3-d5e1-4f7a-afa9-f12b028531ed tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.79662185-8304-4b6b-a469-484d848b6671 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:30 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.79662185-8304-4b6b-a469-484d848b6671 Jul 24 09:55:30 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:30 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-1dbd68d4-d8e2-418b-8760-886aa7520087 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.266s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-1dbd68d4-d8e2-418b-8760-886aa7520087 tempest-ProjectReaderTests-1349320014 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:55:30 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-1dbd68d4-d8e2-418b-8760-886aa7520087 tempest-ProjectReaderTests-1349320014 None] Deleted volume successfully. Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-1dbd68d4-d8e2-418b-8760-886aa7520087 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-9472b508-638d-4ceb-854b-b75737bac69c-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:30 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8af53ec3-d5e1-4f7a-afa9-f12b028531ed tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.79662185-8304-4b6b-a469-484d848b6671" returned: 0 in 0.337s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:30 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-8af53ec3-d5e1-4f7a-afa9-f12b028531ed tempest-ProjectMemberTests-949013298 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.79662185-8304-4b6b-a469-484d848b6671 is being set with open permissions: ugo+rw Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8af53ec3-d5e1-4f7a-afa9-f12b028531ed tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.79662185-8304-4b6b-a469-484d848b6671 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:30 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.79662185-8304-4b6b-a469-484d848b6671 Jul 24 09:55:30 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:55:30 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Flow 'volume_create_manager' (3c2eb018-a9ec-4139-9eca-a6525dc7c4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86a42e0-8333-4190-8be1-9edabbee664b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8af53ec3-d5e1-4f7a-afa9-f12b028531ed tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.79662185-8304-4b6b-a469-484d848b6671" returned: 0 in 0.276s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86a42e0-8333-4190-8be1-9edabbee664b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-825207289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a6e68d-8e0d-4b88-982b-17ab0a1910f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f173c6fb30484362a9b610658bd4c1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:31Z,use_quota=True,user_id='970ee2f61cec4e3b8aa7dbb96c257be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dabdc68-44de-48d5-8c24-0704ab6e78d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dabdc68-44de-48d5-8c24-0704ab6e78d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee473f5-31e6-4d0f-b6f2-aac449b637a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee473f5-31e6-4d0f-b6f2-aac449b637a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8a6e68d-8e0d-4b88-982b-17ab0a1910f7', 'volume_name': 'volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf80276-e426-498e-abb8-728fec856959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf80276-e426-498e-abb8-728fec856959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72143eb-6db8-4ac5-8fb8-201a516dd08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:30 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Volume e8a6e68d-8e0d-4b88-982b-17ab0a1910f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7', 'volume_size': 1} Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:30 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8af53ec3-d5e1-4f7a-afa9-f12b028531ed tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:30 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.info Jul 24 09:55:30 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:31 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8af53ec3-d5e1-4f7a-afa9-f12b028531ed tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.info" returned: 0 in 0.247s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:31 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-8af53ec3-d5e1-4f7a-afa9-f12b028531ed tempest-ProjectMemberTests-949013298 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.info is being set with open permissions: ugo+rw Jul 24 09:55:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8af53ec3-d5e1-4f7a-afa9-f12b028531ed tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:31 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.info Jul 24 09:55:31 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:31 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8af53ec3-d5e1-4f7a-afa9-f12b028531ed tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.info" returned: 0 in 0.258s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8af53ec3-d5e1-4f7a-afa9-f12b028531ed tempest-ProjectMemberTests-949013298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.019s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.540s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-825207289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a6e68d-8e0d-4b88-982b-17ab0a1910f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f173c6fb30484362a9b610658bd4c1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:31Z,use_quota=True,user_id='970ee2f61cec4e3b8aa7dbb96c257be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:55:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Creating volume e8a6e68d-8e0d-4b88-982b-17ab0a1910f7 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:55:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:31 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:55:31 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:55:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:31 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7 1073741824 Jul 24 09:55:31 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:31 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-8af53ec3-d5e1-4f7a-afa9-f12b028531ed tempest-ProjectMemberTests-949013298 None] Create snapshot completed successfully Jul 24 09:55:31 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7 1073741824" returned: 0 in 0.406s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:31 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:31 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7 Jul 24 09:55:31 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:32 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7" returned: 0 in 0.245s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:55:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72143eb-6db8-4ac5-8fb8-201a516dd08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97a3479-63fd-4606-ae31-3094e92592cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:32 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Volume volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7 (e8a6e68d-8e0d-4b88-982b-17ab0a1910f7): created successfully Jul 24 09:55:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97a3479-63fd-4606-ae31-3094e92592cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:32 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Flow 'volume_create_manager' (3c2eb018-a9ec-4139-9eca-a6525dc7c4a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:32 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-8721423a-d8b0-4c8d-940a-9c47b92470a2 tempest-ProjectReaderTests-1349320014 None] Created volume successfully. Jul 24 09:55:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-79662185-8304-4b6b-a469-484d848b6671-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] Lock "cinder-79662185-8304-4b6b-a469-484d848b6671-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-79662185-8304-4b6b-a469-484d848b6671" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:32 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-79662185-8304-4b6b-a469-484d848b6671" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] Deleting offline snapshot 79662185-8304-4b6b-a469-484d848b6671 of volume efbd2a52-b7bd-42ce-a7f1-b406a55ebc42 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:55:32 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] snapshot_file for this snap is: volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.79662185-8304-4b6b-a469-484d848b6671 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:55:32 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b4992d-a265-42be-b9af-3c0df29bf5fe]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:32 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.79662185-8304-4b6b-a469-484d848b6671 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:32 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.79662185-8304-4b6b-a469-484d848b6671 Jul 24 09:55:32 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:33 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.79662185-8304-4b6b-a469-484d848b6671" returned: 0 in 0.375s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:55:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b1ea5db9-7950-4ce0-90a6-46bdcccc4fe0 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b1ea5db9-7950-4ce0-90a6-46bdcccc4fe0 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:33 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2f238c-b1b4-4296-b8bd-6368986828b8]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:33 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-b1ea5db9-7950-4ce0-90a6-46bdcccc4fe0 tempest-ProjectReaderTests-1349320014 None] Creating offline snapshot 870dbcee-9032-42af-aaa2-7b40c61f35de of volume e8a6e68d-8e0d-4b88-982b-17ab0a1910f7 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:55:33 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ac4fda-63ef-4208-8fc3-db39c213277e]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b1ea5db9-7950-4ce0-90a6-46bdcccc4fe0 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:33 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42 Jul 24 09:55:33 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:33 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7 Jul 24 09:55:33 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:33 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42" returned: 0 in 0.357s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.79662185-8304-4b6b-a469-484d848b6671 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:33 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.79662185-8304-4b6b-a469-484d848b6671 Jul 24 09:55:33 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:33 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b1ea5db9-7950-4ce0-90a6-46bdcccc4fe0 tempest-ProjectReaderTests-1349320014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7" returned: 0 in 0.374s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b1ea5db9-7950-4ce0-90a6-46bdcccc4fe0 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.870dbcee-9032-42af-aaa2-7b40c61f35de 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:33 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.870dbcee-9032-42af-aaa2-7b40c61f35de 1G Jul 24 09:55:33 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:33 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.79662185-8304-4b6b-a469-484d848b6671" returned: 0 in 0.346s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.79662185-8304-4b6b-a469-484d848b6671 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:33 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.79662185-8304-4b6b-a469-484d848b6671 Jul 24 09:55:33 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:33 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b1ea5db9-7950-4ce0-90a6-46bdcccc4fe0 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.870dbcee-9032-42af-aaa2-7b40c61f35de 1G" returned: 0 in 0.466s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:33 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b1ea5db9-7950-4ce0-90a6-46bdcccc4fe0 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.870dbcee-9032-42af-aaa2-7b40c61f35de {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:33 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.870dbcee-9032-42af-aaa2-7b40c61f35de Jul 24 09:55:33 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:34 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42.79662185-8304-4b6b-a469-484d848b6671" returned: 0 in 0.276s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-79662185-8304-4b6b-a469-484d848b6671" released by "_delete_snapshot" :: held 1.447s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42" released by "delete_snapshot" :: held 1.472s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:34 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] Created reservations ['766d8cee-aee0-4c5b-9cb6-ea3eb4a241e8', 'e278da38-db88-4a41-8e88-8d5ef2b082e5', 'edff5de0-092e-4680-b348-2dfcce3ceab9', '2becac73-e7e2-4809-b243-a5ef5e15167f'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:34 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] Delete snapshot completed successfully. Jul 24 09:55:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-baebbdfe-0526-42b9-b38d-ce99ec922d9f tempest-ProjectMemberTests-949013298 None] Lock "cinder-79662185-8304-4b6b-a469-484d848b6671-delete_snapshot" released by "delete_snapshot" :: held 1.614s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:34 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b1ea5db9-7950-4ce0-90a6-46bdcccc4fe0 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.870dbcee-9032-42af-aaa2-7b40c61f35de" returned: 0 in 0.310s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:34 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-b1ea5db9-7950-4ce0-90a6-46bdcccc4fe0 tempest-ProjectReaderTests-1349320014 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.870dbcee-9032-42af-aaa2-7b40c61f35de is being set with open permissions: ugo+rw Jul 24 09:55:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b1ea5db9-7950-4ce0-90a6-46bdcccc4fe0 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.870dbcee-9032-42af-aaa2-7b40c61f35de {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:34 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.870dbcee-9032-42af-aaa2-7b40c61f35de Jul 24 09:55:34 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:34 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b1ea5db9-7950-4ce0-90a6-46bdcccc4fe0 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.870dbcee-9032-42af-aaa2-7b40c61f35de" returned: 0 in 0.243s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b1ea5db9-7950-4ce0-90a6-46bdcccc4fe0 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:34 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.info Jul 24 09:55:34 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-be731464-3083-4dec-9ce1-8a54ed474bf4 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:34 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-be731464-3083-4dec-9ce1-8a54ed474bf4 tempest-ProjectMemberTests-949013298 None] Lock "cinder-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b1ea5db9-7950-4ce0-90a6-46bdcccc4fe0 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.info" returned: 0 in 0.252s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:34 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-b1ea5db9-7950-4ce0-90a6-46bdcccc4fe0 tempest-ProjectReaderTests-1349320014 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.info is being set with open permissions: ugo+rw Jul 24 09:55:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b1ea5db9-7950-4ce0-90a6-46bdcccc4fe0 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:34 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.info Jul 24 09:55:34 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-be731464-3083-4dec-9ce1-8a54ed474bf4 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:34 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-be731464-3083-4dec-9ce1-8a54ed474bf4 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42" acquired by "delete_volume" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:34 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88ecbdc-0606-4b57-a6f7-a30463ba0eab]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be731464-3083-4dec-9ce1-8a54ed474bf4 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:34 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42 Jul 24 09:55:34 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:34 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:34 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-b1ea5db9-7950-4ce0-90a6-46bdcccc4fe0 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.info" returned: 0 in 0.250s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-b1ea5db9-7950-4ce0-90a6-46bdcccc4fe0 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:35 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-b1ea5db9-7950-4ce0-90a6-46bdcccc4fe0 tempest-ProjectReaderTests-1349320014 None] Create snapshot completed successfully Jul 24 09:55:35 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be731464-3083-4dec-9ce1-8a54ed474bf4 tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42" returned: 0 in 0.362s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be731464-3083-4dec-9ce1-8a54ed474bf4 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:35 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42 Jul 24 09:55:35 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:35 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be731464-3083-4dec-9ce1-8a54ed474bf4 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42" returned: 0 in 0.242s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:35 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-be731464-3083-4dec-9ce1-8a54ed474bf4 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42" released by "delete_volume" :: held 0.658s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:35 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-be731464-3083-4dec-9ce1-8a54ed474bf4 tempest-ProjectMemberTests-949013298 None] Created reservations ['fc9a83ca-0429-4a21-91bd-65d55f8bfeef', '6c7559f0-5aa3-43e1-bc60-a9c688a82512', '1afba4df-83e4-48fe-971a-94e0d6454396', 'fd2289b1-91fd-4907-be5c-1692ca04e776'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-be731464-3083-4dec-9ce1-8a54ed474bf4 tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-be731464-3083-4dec-9ce1-8a54ed474bf4 tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:35 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-be731464-3083-4dec-9ce1-8a54ed474bf4 tempest-ProjectMemberTests-949013298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:35 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-be731464-3083-4dec-9ce1-8a54ed474bf4 tempest-ProjectMemberTests-949013298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-be731464-3083-4dec-9ce1-8a54ed474bf4 tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be731464-3083-4dec-9ce1-8a54ed474bf4 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:35 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:55:35 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:35 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:35 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-be731464-3083-4dec-9ce1-8a54ed474bf4 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.242s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:35 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-be731464-3083-4dec-9ce1-8a54ed474bf4 tempest-ProjectMemberTests-949013298 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:55:35 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-be731464-3083-4dec-9ce1-8a54ed474bf4 tempest-ProjectMemberTests-949013298 None] Deleted volume successfully. Jul 24 09:55:35 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-be731464-3083-4dec-9ce1-8a54ed474bf4 tempest-ProjectMemberTests-949013298 None] Lock "cinder-efbd2a52-b7bd-42ce-a7f1-b406a55ebc42-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-870dbcee-9032-42af-aaa2-7b40c61f35de-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] Lock "cinder-870dbcee-9032-42af-aaa2-7b40c61f35de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-quobyte-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-quobyte-870dbcee-9032-42af-aaa2-7b40c61f35de" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-870dbcee-9032-42af-aaa2-7b40c61f35de" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] Deleting offline snapshot 870dbcee-9032-42af-aaa2-7b40c61f35de of volume e8a6e68d-8e0d-4b88-982b-17ab0a1910f7 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] snapshot_file for this snap is: volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.870dbcee-9032-42af-aaa2-7b40c61f35de {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[5782d931-354e-41b2-92d0-944e240f8a25]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.870dbcee-9032-42af-aaa2-7b40c61f35de {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Flow 'volume_create_manager' (f382e6b9-cd2e-4691-ac43-21512d4e2234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5be14f-aa55-4757-baee-052a4be5f2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5be14f-aa55-4757-baee-052a4be5f2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2129269406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70535347-9bf9-4ac2-9321-63e3fe199368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b587ba61104b63b86e5a657e21be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:36Z,use_quota=True,user_id='bb693ea0a87140e195a91cab5d5e34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912f70be-1a4b-4c3b-a9f1-b70315998c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912f70be-1a4b-4c3b-a9f1-b70315998c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c7b70b-e151-46e8-ad13-246ae7463c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c7b70b-e151-46e8-ad13-246ae7463c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70535347-9bf9-4ac2-9321-63e3fe199368', 'volume_name': 'volume-70535347-9bf9-4ac2-9321-63e3fe199368', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371cd136-da58-45a6-a66e-8c359624ca99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371cd136-da58-45a6-a66e-8c359624ca99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86ab109-99f1-40f4-b89d-5116c2d9d584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:36 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Volume 70535347-9bf9-4ac2-9321-63e3fe199368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70535347-9bf9-4ac2-9321-63e3fe199368', 'volume_size': 1} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2129269406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70535347-9bf9-4ac2-9321-63e3fe199368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b587ba61104b63b86e5a657e21be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:36Z,use_quota=True,user_id='bb693ea0a87140e195a91cab5d5e34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Creating volume 70535347-9bf9-4ac2-9321-63e3fe199368 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:36 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.870dbcee-9032-42af-aaa2-7b40c61f35de Jul 24 09:55:36 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:55:36 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:36 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368 1073741824 Jul 24 09:55:36 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:36 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.870dbcee-9032-42af-aaa2-7b40c61f35de" returned: 0 in 0.375s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2458367-fd1b-4e0c-88c4-869450093bb3]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:36 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7 Jul 24 09:55:36 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:36 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368 1073741824" returned: 0 in 0.419s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:36 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:36 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368 Jul 24 09:55:36 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:37 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7" returned: 0 in 0.373s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.870dbcee-9032-42af-aaa2-7b40c61f35de {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:37 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.870dbcee-9032-42af-aaa2-7b40c61f35de Jul 24 09:55:37 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:37 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368" returned: 0 in 0.254s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86ab109-99f1-40f4-b89d-5116c2d9d584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70535347-9bf9-4ac2-9321-63e3fe199368', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0cc71fd-58ab-4083-a17b-35e7b861d128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:37 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Volume volume-70535347-9bf9-4ac2-9321-63e3fe199368 (70535347-9bf9-4ac2-9321-63e3fe199368): created successfully Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0cc71fd-58ab-4083-a17b-35e7b861d128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Flow 'volume_create_manager' (f382e6b9-cd2e-4691-ac43-21512d4e2234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:37 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-11b72aa7-65ed-46f1-9648-ddaa3ed9645d tempest-ProjectMemberTests-949013298 None] Created volume successfully. Jul 24 09:55:37 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.870dbcee-9032-42af-aaa2-7b40c61f35de" returned: 0 in 0.383s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.870dbcee-9032-42af-aaa2-7b40c61f35de {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:37 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.870dbcee-9032-42af-aaa2-7b40c61f35de Jul 24 09:55:37 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0274897e-637e-46e5-bb6c-033250f122bd tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0274897e-637e-46e5-bb6c-033250f122bd tempest-ProjectMemberTests-949013298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-0274897e-637e-46e5-bb6c-033250f122bd tempest-ProjectMemberTests-949013298 None] Creating offline snapshot 994b6f6d-ea43-46b6-b02d-77c2dac71e08 of volume 70535347-9bf9-4ac2-9321-63e3fe199368 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[683e26df-91d3-4607-a280-6870a50968e9]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0274897e-637e-46e5-bb6c-033250f122bd tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:37 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368 Jul 24 09:55:37 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:37 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7.870dbcee-9032-42af-aaa2-7b40c61f35de" returned: 0 in 0.248s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-870dbcee-9032-42af-aaa2-7b40c61f35de" released by "_delete_snapshot" :: held 1.477s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7" released by "delete_snapshot" :: held 1.502s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] Created reservations ['37c22d12-ba2a-4aa1-806f-d387b01d4958', 'aad5efdc-6bce-43f8-b472-6b870849d40e', 'cd8df5b7-de85-47e9-962f-33726a7902d8', 'e591f9de-a002-4e34-a32c-2d64e4343379'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:37 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] Delete snapshot completed successfully. Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-fc470932-b51b-4385-8f99-83f9c08bf62d tempest-ProjectReaderTests-1349320014 None] Lock "cinder-870dbcee-9032-42af-aaa2-7b40c61f35de-delete_snapshot" released by "delete_snapshot" :: held 1.641s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:37 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0274897e-637e-46e5-bb6c-033250f122bd tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368" returned: 0 in 0.377s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:37 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0274897e-637e-46e5-bb6c-033250f122bd tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.994b6f6d-ea43-46b6-b02d-77c2dac71e08 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:37 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.994b6f6d-ea43-46b6-b02d-77c2dac71e08 1G Jul 24 09:55:37 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:38 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0274897e-637e-46e5-bb6c-033250f122bd tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.994b6f6d-ea43-46b6-b02d-77c2dac71e08 1G" returned: 0 in 0.390s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0274897e-637e-46e5-bb6c-033250f122bd tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70535347-9bf9-4ac2-9321-63e3fe199368 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.994b6f6d-ea43-46b6-b02d-77c2dac71e08 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:38 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70535347-9bf9-4ac2-9321-63e3fe199368 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.994b6f6d-ea43-46b6-b02d-77c2dac71e08 Jul 24 09:55:38 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e3b3939d-0007-4d2a-ad6b-8cece038bca7 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e3b3939d-0007-4d2a-ad6b-8cece038bca7 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e3b3939d-0007-4d2a-ad6b-8cece038bca7 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "cinder-quobyte-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:38 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e3b3939d-0007-4d2a-ad6b-8cece038bca7 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7" acquired by "delete_volume" :: waited 0.022s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:38 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9b63c4-7a3f-476c-83c2-9a552483b782]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e3b3939d-0007-4d2a-ad6b-8cece038bca7 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:38 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0274897e-637e-46e5-bb6c-033250f122bd tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70535347-9bf9-4ac2-9321-63e3fe199368 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.994b6f6d-ea43-46b6-b02d-77c2dac71e08" returned: 0 in 0.317s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:38 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-0274897e-637e-46e5-bb6c-033250f122bd tempest-ProjectMemberTests-949013298 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.994b6f6d-ea43-46b6-b02d-77c2dac71e08 is being set with open permissions: ugo+rw Jul 24 09:55:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0274897e-637e-46e5-bb6c-033250f122bd tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.994b6f6d-ea43-46b6-b02d-77c2dac71e08 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:38 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7 Jul 24 09:55:38 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:38 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.994b6f6d-ea43-46b6-b02d-77c2dac71e08 Jul 24 09:55:38 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:38 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:38 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e3b3939d-0007-4d2a-ad6b-8cece038bca7 tempest-ProjectReaderTests-1349320014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7" returned: 0 in 0.364s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e3b3939d-0007-4d2a-ad6b-8cece038bca7 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0274897e-637e-46e5-bb6c-033250f122bd tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.994b6f6d-ea43-46b6-b02d-77c2dac71e08" returned: 0 in 0.277s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:38 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7 Jul 24 09:55:38 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:38 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0274897e-637e-46e5-bb6c-033250f122bd tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:38 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.info Jul 24 09:55:38 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:39 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e3b3939d-0007-4d2a-ad6b-8cece038bca7 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7" returned: 0 in 0.262s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:39 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e3b3939d-0007-4d2a-ad6b-8cece038bca7 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-quobyte-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7" released by "delete_volume" :: held 0.694s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:39 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0274897e-637e-46e5-bb6c-033250f122bd tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.info" returned: 0 in 0.280s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:39 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-0274897e-637e-46e5-bb6c-033250f122bd tempest-ProjectMemberTests-949013298 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.info is being set with open permissions: ugo+rw Jul 24 09:55:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0274897e-637e-46e5-bb6c-033250f122bd tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:39 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-e3b3939d-0007-4d2a-ad6b-8cece038bca7 tempest-ProjectReaderTests-1349320014 None] Created reservations ['c0035b71-2a99-4baf-a101-640798c5a542', 'd89c45ee-339c-4a66-8fed-92306f25e586', 'a6790ad2-0d36-4f2a-977b-f6c8987ffbdf', 'cebc9770-1c57-4555-a96d-7dd0522bc8ac'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:39 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.info Jul 24 09:55:39 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e3b3939d-0007-4d2a-ad6b-8cece038bca7 tempest-ProjectReaderTests-1349320014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e3b3939d-0007-4d2a-ad6b-8cece038bca7 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e3b3939d-0007-4d2a-ad6b-8cece038bca7 tempest-ProjectReaderTests-1349320014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e3b3939d-0007-4d2a-ad6b-8cece038bca7 tempest-ProjectReaderTests-1349320014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e3b3939d-0007-4d2a-ad6b-8cece038bca7 tempest-ProjectReaderTests-1349320014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e3b3939d-0007-4d2a-ad6b-8cece038bca7 tempest-ProjectReaderTests-1349320014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:39 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:55:39 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:39 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0274897e-637e-46e5-bb6c-033250f122bd tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.info" returned: 0 in 0.298s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0274897e-637e-46e5-bb6c-033250f122bd tempest-ProjectMemberTests-949013298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:39 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e3b3939d-0007-4d2a-ad6b-8cece038bca7 tempest-ProjectReaderTests-1349320014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.255s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:39 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-e3b3939d-0007-4d2a-ad6b-8cece038bca7 tempest-ProjectReaderTests-1349320014 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:55:39 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e3b3939d-0007-4d2a-ad6b-8cece038bca7 tempest-ProjectReaderTests-1349320014 None] Deleted volume successfully. Jul 24 09:55:39 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-0274897e-637e-46e5-bb6c-033250f122bd tempest-ProjectMemberTests-949013298 None] Create snapshot completed successfully Jul 24 09:55:39 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-e3b3939d-0007-4d2a-ad6b-8cece038bca7 tempest-ProjectReaderTests-1349320014 None] Lock "cinder-e8a6e68d-8e0d-4b88-982b-17ab0a1910f7-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-994b6f6d-ea43-46b6-b02d-77c2dac71e08-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] Lock "cinder-994b6f6d-ea43-46b6-b02d-77c2dac71e08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-70535347-9bf9-4ac2-9321-63e3fe199368" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-70535347-9bf9-4ac2-9321-63e3fe199368" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-994b6f6d-ea43-46b6-b02d-77c2dac71e08" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:40 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-994b6f6d-ea43-46b6-b02d-77c2dac71e08" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] Deleting offline snapshot 994b6f6d-ea43-46b6-b02d-77c2dac71e08 of volume 70535347-9bf9-4ac2-9321-63e3fe199368 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:55:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] snapshot_file for this snap is: volume-70535347-9bf9-4ac2-9321-63e3fe199368.994b6f6d-ea43-46b6-b02d-77c2dac71e08 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:55:40 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5899221-820c-46aa-a22a-13c44bad74a7]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.994b6f6d-ea43-46b6-b02d-77c2dac71e08 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:40 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.994b6f6d-ea43-46b6-b02d-77c2dac71e08 Jul 24 09:55:40 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:41 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.994b6f6d-ea43-46b6-b02d-77c2dac71e08" returned: 0 in 0.370s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:41 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70535347-9bf9-4ac2-9321-63e3fe199368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:55:41 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b1895e-35ce-4b75-854d-1a08be12ceaf]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:41 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368 Jul 24 09:55:41 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:41 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368" returned: 0 in 0.370s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.994b6f6d-ea43-46b6-b02d-77c2dac71e08 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:41 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.994b6f6d-ea43-46b6-b02d-77c2dac71e08 Jul 24 09:55:41 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:41 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.994b6f6d-ea43-46b6-b02d-77c2dac71e08" returned: 0 in 0.356s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.994b6f6d-ea43-46b6-b02d-77c2dac71e08 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:41 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.994b6f6d-ea43-46b6-b02d-77c2dac71e08 Jul 24 09:55:41 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:42 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368.994b6f6d-ea43-46b6-b02d-77c2dac71e08" returned: 0 in 0.253s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-994b6f6d-ea43-46b6-b02d-77c2dac71e08" released by "_delete_snapshot" :: held 1.454s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-70535347-9bf9-4ac2-9321-63e3fe199368" released by "delete_snapshot" :: held 1.481s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:42 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] Created reservations ['9a2acb0e-8626-448d-8c3c-90793be2525e', '7fa8d169-a961-4c30-830b-5b2acdf29f8b', 'a6355a13-92be-4a31-9095-84ad8404d7b6', '6f0579a6-1583-4813-bf3a-1d6177b9d1fe'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:42 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] Delete snapshot completed successfully. Jul 24 09:55:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-796ef6c4-5528-41b2-a5a9-10da148c09e7 tempest-ProjectMemberTests-949013298 None] Lock "cinder-994b6f6d-ea43-46b6-b02d-77c2dac71e08-delete_snapshot" released by "delete_snapshot" :: held 1.620s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f47472f7-3dc6-438f-a804-73ab86ceb7d7 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-70535347-9bf9-4ac2-9321-63e3fe199368-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f47472f7-3dc6-438f-a804-73ab86ceb7d7 tempest-ProjectMemberTests-949013298 None] Lock "cinder-70535347-9bf9-4ac2-9321-63e3fe199368-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f47472f7-3dc6-438f-a804-73ab86ceb7d7 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-70535347-9bf9-4ac2-9321-63e3fe199368" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:42 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f47472f7-3dc6-438f-a804-73ab86ceb7d7 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-70535347-9bf9-4ac2-9321-63e3fe199368" acquired by "delete_volume" :: waited 0.014s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:43 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[519aa323-0ef6-4492-8015-e5c0d40a06cb]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f47472f7-3dc6-438f-a804-73ab86ceb7d7 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:43 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368 Jul 24 09:55:43 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:43 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f47472f7-3dc6-438f-a804-73ab86ceb7d7 tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368" returned: 0 in 0.369s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f47472f7-3dc6-438f-a804-73ab86ceb7d7 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:43 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368 Jul 24 09:55:43 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:43 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f47472f7-3dc6-438f-a804-73ab86ceb7d7 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-70535347-9bf9-4ac2-9321-63e3fe199368" returned: 0 in 0.244s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f47472f7-3dc6-438f-a804-73ab86ceb7d7 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-70535347-9bf9-4ac2-9321-63e3fe199368" released by "delete_volume" :: held 0.671s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:43 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-f47472f7-3dc6-438f-a804-73ab86ceb7d7 tempest-ProjectMemberTests-949013298 None] Created reservations ['48571490-1cea-49ea-98c7-9441157eaed6', '1cedcd56-048a-499b-a829-d4055a5b21dc', '24bb01c9-06db-4898-9e0e-b5112f5fe61f', '98606475-9fa8-4565-9a1c-1be0fbfe933a'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f47472f7-3dc6-438f-a804-73ab86ceb7d7 tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f47472f7-3dc6-438f-a804-73ab86ceb7d7 tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f47472f7-3dc6-438f-a804-73ab86ceb7d7 tempest-ProjectMemberTests-949013298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-f47472f7-3dc6-438f-a804-73ab86ceb7d7 tempest-ProjectMemberTests-949013298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-f47472f7-3dc6-438f-a804-73ab86ceb7d7 tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f47472f7-3dc6-438f-a804-73ab86ceb7d7 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:43 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:55:43 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:43 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-f47472f7-3dc6-438f-a804-73ab86ceb7d7 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.246s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:43 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-f47472f7-3dc6-438f-a804-73ab86ceb7d7 tempest-ProjectMemberTests-949013298 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:55:43 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-f47472f7-3dc6-438f-a804-73ab86ceb7d7 tempest-ProjectMemberTests-949013298 None] Deleted volume successfully. Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-f47472f7-3dc6-438f-a804-73ab86ceb7d7 tempest-ProjectMemberTests-949013298 None] Lock "cinder-70535347-9bf9-4ac2-9321-63e3fe199368-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Flow 'volume_create_manager' (51fcc545-f833-4288-9f45-e3ee88cc98d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f265020-acac-4764-b95f-7b4660ce8efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f265020-acac-4764-b95f-7b4660ce8efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-198682649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f204dfdf-287b-4c68-b69d-88259557a877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b587ba61104b63b86e5a657e21be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:44Z,use_quota=True,user_id='bb693ea0a87140e195a91cab5d5e34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a58cd3-7b6d-4ae6-9d3d-85f88027563e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a58cd3-7b6d-4ae6-9d3d-85f88027563e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02fb9274-2ec7-4b15-823d-9fe4d7a009e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02fb9274-2ec7-4b15-823d-9fe4d7a009e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f204dfdf-287b-4c68-b69d-88259557a877', 'volume_name': 'volume-f204dfdf-287b-4c68-b69d-88259557a877', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba18031-0f4e-4472-bfd5-ab050327a7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba18031-0f4e-4472-bfd5-ab050327a7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f15e6351-5d7f-4a6c-af2d-e974e768e513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:44 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Volume f204dfdf-287b-4c68-b69d-88259557a877: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f204dfdf-287b-4c68-b69d-88259557a877', 'volume_size': 1} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-198682649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f204dfdf-287b-4c68-b69d-88259557a877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b587ba61104b63b86e5a657e21be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:44Z,use_quota=True,user_id='bb693ea0a87140e195a91cab5d5e34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Creating volume f204dfdf-287b-4c68-b69d-88259557a877 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:55:44 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:55:44 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:44 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877 1073741824 Jul 24 09:55:44 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:44 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877 1073741824" returned: 0 in 0.453s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:45 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877 Jul 24 09:55:45 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:45 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877" returned: 0 in 0.251s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:55:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f15e6351-5d7f-4a6c-af2d-e974e768e513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f204dfdf-287b-4c68-b69d-88259557a877', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b3d017-9b1a-4050-b1f1-4c2701337137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:45 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Volume volume-f204dfdf-287b-4c68-b69d-88259557a877 (f204dfdf-287b-4c68-b69d-88259557a877): created successfully Jul 24 09:55:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b3d017-9b1a-4050-b1f1-4c2701337137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:45 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Flow 'volume_create_manager' (51fcc545-f833-4288-9f45-e3ee88cc98d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:45 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-869199db-ba5a-4362-bb58-e6119e6c0d4f tempest-ProjectMemberTests-949013298 None] Created volume successfully. Jul 24 09:55:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-80ca47e1-10a7-41ad-b575-6e99c1188fbb tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-80ca47e1-10a7-41ad-b575-6e99c1188fbb tempest-ProjectMemberTests-949013298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:45 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-80ca47e1-10a7-41ad-b575-6e99c1188fbb tempest-ProjectMemberTests-949013298 None] Creating offline snapshot 09e301aa-7cc3-410b-8140-5a6dbc29dcdc of volume f204dfdf-287b-4c68-b69d-88259557a877 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:55:45 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[161ee42b-dd90-493b-b459-6fc73299f86e]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:45 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-80ca47e1-10a7-41ad-b575-6e99c1188fbb tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:45 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877 Jul 24 09:55:45 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:46 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-80ca47e1-10a7-41ad-b575-6e99c1188fbb tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877" returned: 0 in 0.362s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-80ca47e1-10a7-41ad-b575-6e99c1188fbb tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.09e301aa-7cc3-410b-8140-5a6dbc29dcdc 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:46 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.09e301aa-7cc3-410b-8140-5a6dbc29dcdc 1G Jul 24 09:55:46 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:46 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-80ca47e1-10a7-41ad-b575-6e99c1188fbb tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.09e301aa-7cc3-410b-8140-5a6dbc29dcdc 1G" returned: 0 in 0.426s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-80ca47e1-10a7-41ad-b575-6e99c1188fbb tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f204dfdf-287b-4c68-b69d-88259557a877 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.09e301aa-7cc3-410b-8140-5a6dbc29dcdc {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:46 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f204dfdf-287b-4c68-b69d-88259557a877 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.09e301aa-7cc3-410b-8140-5a6dbc29dcdc Jul 24 09:55:46 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:46 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-80ca47e1-10a7-41ad-b575-6e99c1188fbb tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f204dfdf-287b-4c68-b69d-88259557a877 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.09e301aa-7cc3-410b-8140-5a6dbc29dcdc" returned: 0 in 0.318s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:46 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-80ca47e1-10a7-41ad-b575-6e99c1188fbb tempest-ProjectMemberTests-949013298 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.09e301aa-7cc3-410b-8140-5a6dbc29dcdc is being set with open permissions: ugo+rw Jul 24 09:55:46 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-80ca47e1-10a7-41ad-b575-6e99c1188fbb tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.09e301aa-7cc3-410b-8140-5a6dbc29dcdc {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:46 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.09e301aa-7cc3-410b-8140-5a6dbc29dcdc Jul 24 09:55:46 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:47 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-80ca47e1-10a7-41ad-b575-6e99c1188fbb tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.09e301aa-7cc3-410b-8140-5a6dbc29dcdc" returned: 0 in 0.256s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-80ca47e1-10a7-41ad-b575-6e99c1188fbb tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:47 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.info Jul 24 09:55:47 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:47 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-80ca47e1-10a7-41ad-b575-6e99c1188fbb tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.info" returned: 0 in 0.261s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:47 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-80ca47e1-10a7-41ad-b575-6e99c1188fbb tempest-ProjectMemberTests-949013298 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.info is being set with open permissions: ugo+rw Jul 24 09:55:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-80ca47e1-10a7-41ad-b575-6e99c1188fbb tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:47 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.info Jul 24 09:55:47 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:47 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-80ca47e1-10a7-41ad-b575-6e99c1188fbb tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.info" returned: 0 in 0.234s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-80ca47e1-10a7-41ad-b575-6e99c1188fbb tempest-ProjectMemberTests-949013298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.936s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:47 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-80ca47e1-10a7-41ad-b575-6e99c1188fbb tempest-ProjectMemberTests-949013298 None] Create snapshot completed successfully Jul 24 09:55:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-09e301aa-7cc3-410b-8140-5a6dbc29dcdc-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] Lock "cinder-09e301aa-7cc3-410b-8140-5a6dbc29dcdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-f204dfdf-287b-4c68-b69d-88259557a877" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-f204dfdf-287b-4c68-b69d-88259557a877" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-09e301aa-7cc3-410b-8140-5a6dbc29dcdc" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:47 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-09e301aa-7cc3-410b-8140-5a6dbc29dcdc" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] Deleting offline snapshot 09e301aa-7cc3-410b-8140-5a6dbc29dcdc of volume f204dfdf-287b-4c68-b69d-88259557a877 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:55:47 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] snapshot_file for this snap is: volume-f204dfdf-287b-4c68-b69d-88259557a877.09e301aa-7cc3-410b-8140-5a6dbc29dcdc {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:55:47 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dccfaa-3336-45e8-951f-b1a7fad17b6b]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:47 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.09e301aa-7cc3-410b-8140-5a6dbc29dcdc {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:47 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.09e301aa-7cc3-410b-8140-5a6dbc29dcdc Jul 24 09:55:47 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:48 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.09e301aa-7cc3-410b-8140-5a6dbc29dcdc" returned: 0 in 0.368s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:48 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f204dfdf-287b-4c68-b69d-88259557a877(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:55:48 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[29580132-88ee-490f-ae2e-cb474130c95d]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:48 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877 Jul 24 09:55:48 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:48 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877" returned: 0 in 0.371s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.09e301aa-7cc3-410b-8140-5a6dbc29dcdc {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:48 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.09e301aa-7cc3-410b-8140-5a6dbc29dcdc Jul 24 09:55:48 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:48 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.09e301aa-7cc3-410b-8140-5a6dbc29dcdc" returned: 0 in 0.332s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.09e301aa-7cc3-410b-8140-5a6dbc29dcdc {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:48 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.09e301aa-7cc3-410b-8140-5a6dbc29dcdc Jul 24 09:55:48 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:49 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877.09e301aa-7cc3-410b-8140-5a6dbc29dcdc" returned: 0 in 0.257s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-09e301aa-7cc3-410b-8140-5a6dbc29dcdc" released by "_delete_snapshot" :: held 1.419s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-f204dfdf-287b-4c68-b69d-88259557a877" released by "delete_snapshot" :: held 1.438s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:49 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] Created reservations ['04051546-9e36-4473-9d2f-a9fdf9d49f41', 'efa2371c-4f01-48ca-a05f-a8d8af090b02', '6190288a-ac4d-4bbb-b7c6-09db856153be', 'e3f1bffd-6fe8-48ea-8826-e6acff209dae'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:49 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] Delete snapshot completed successfully. Jul 24 09:55:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-7343f9de-128f-4294-81e0-a0828e98135a tempest-ProjectMemberTests-949013298 None] Lock "cinder-09e301aa-7cc3-410b-8140-5a6dbc29dcdc-delete_snapshot" released by "delete_snapshot" :: held 1.599s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0b8953c6-7af5-4795-bf64-a6caf3450836 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-f204dfdf-287b-4c68-b69d-88259557a877-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0b8953c6-7af5-4795-bf64-a6caf3450836 tempest-ProjectMemberTests-949013298 None] Lock "cinder-f204dfdf-287b-4c68-b69d-88259557a877-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0b8953c6-7af5-4795-bf64-a6caf3450836 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-f204dfdf-287b-4c68-b69d-88259557a877" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0b8953c6-7af5-4795-bf64-a6caf3450836 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-f204dfdf-287b-4c68-b69d-88259557a877" acquired by "delete_volume" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:50 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[68554f05-82a9-4748-824e-235093e02a13]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0b8953c6-7af5-4795-bf64-a6caf3450836 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:50 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877 Jul 24 09:55:50 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:50 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0b8953c6-7af5-4795-bf64-a6caf3450836 tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877" returned: 0 in 0.362s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0b8953c6-7af5-4795-bf64-a6caf3450836 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:50 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877 Jul 24 09:55:50 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:50 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0b8953c6-7af5-4795-bf64-a6caf3450836 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-f204dfdf-287b-4c68-b69d-88259557a877" returned: 0 in 0.267s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:50 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0b8953c6-7af5-4795-bf64-a6caf3450836 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-f204dfdf-287b-4c68-b69d-88259557a877" released by "delete_volume" :: held 0.688s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:50 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-0b8953c6-7af5-4795-bf64-a6caf3450836 tempest-ProjectMemberTests-949013298 None] Created reservations ['3fabe9b1-c2c3-4146-b8d8-68fc6f218111', '32b2df34-5a88-42ed-9317-1b09dc74c3b3', 'e8cc54dc-31d7-4eb3-bb30-c4c1a7790c8b', '8c72d4e9-7ad1-431e-ae8c-787dde5de792'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0b8953c6-7af5-4795-bf64-a6caf3450836 tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0b8953c6-7af5-4795-bf64-a6caf3450836 tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:50 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0b8953c6-7af5-4795-bf64-a6caf3450836 tempest-ProjectMemberTests-949013298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:50 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-0b8953c6-7af5-4795-bf64-a6caf3450836 tempest-ProjectMemberTests-949013298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0b8953c6-7af5-4795-bf64-a6caf3450836 tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0b8953c6-7af5-4795-bf64-a6caf3450836 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:50 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:55:50 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:51 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0b8953c6-7af5-4795-bf64-a6caf3450836 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.256s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-0b8953c6-7af5-4795-bf64-a6caf3450836 tempest-ProjectMemberTests-949013298 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:55:51 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-0b8953c6-7af5-4795-bf64-a6caf3450836 tempest-ProjectMemberTests-949013298 None] Deleted volume successfully. Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0b8953c6-7af5-4795-bf64-a6caf3450836 tempest-ProjectMemberTests-949013298 None] Lock "cinder-f204dfdf-287b-4c68-b69d-88259557a877-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Flow 'volume_create_manager' (6177d14d-0d7e-4e3d-b6c9-807020f8dfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1323173d-4296-478f-bff2-b00e1da8f9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1323173d-4296-478f-bff2-b00e1da8f9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-533119385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86eb32a5-122d-478d-9f52-0a81bb77f9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b587ba61104b63b86e5a657e21be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:51Z,use_quota=True,user_id='bb693ea0a87140e195a91cab5d5e34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2debcc09-f1df-4043-9a8d-eaf8ee470035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2debcc09-f1df-4043-9a8d-eaf8ee470035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f03a9cb-191b-4ae0-9f1c-1bcbc57aa250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f03a9cb-191b-4ae0-9f1c-1bcbc57aa250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86eb32a5-122d-478d-9f52-0a81bb77f9aa', 'volume_name': 'volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (855a50fa-e5d4-4208-b376-cf1255302f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (855a50fa-e5d4-4208-b376-cf1255302f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1e7c51-750e-48ff-a51d-3301fb613afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:51 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Volume 86eb32a5-122d-478d-9f52-0a81bb77f9aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa', 'volume_size': 1} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-533119385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86eb32a5-122d-478d-9f52-0a81bb77f9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b587ba61104b63b86e5a657e21be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:51Z,use_quota=True,user_id='bb693ea0a87140e195a91cab5d5e34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Creating volume 86eb32a5-122d-478d-9f52-0a81bb77f9aa {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:55:51 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:55:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:51 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa 1073741824 Jul 24 09:55:51 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:52 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa 1073741824" returned: 0 in 0.437s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:52 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa Jul 24 09:55:52 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:52 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa" returned: 0 in 0.257s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:55:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1e7c51-750e-48ff-a51d-3301fb613afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f18b1b1-da14-4382-aff3-842a28b558a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:52 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Volume volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa (86eb32a5-122d-478d-9f52-0a81bb77f9aa): created successfully Jul 24 09:55:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f18b1b1-da14-4382-aff3-842a28b558a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:52 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Flow 'volume_create_manager' (6177d14d-0d7e-4e3d-b6c9-807020f8dfa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:52 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-ef070b37-8210-447c-897c-5b1e3e993bcd tempest-ProjectMemberTests-949013298 None] Created volume successfully. Jul 24 09:55:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ec23ccb0-6442-4ba9-a6fd-0eade772f9b1 tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ec23ccb0-6442-4ba9-a6fd-0eade772f9b1 tempest-ProjectMemberTests-949013298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-ec23ccb0-6442-4ba9-a6fd-0eade772f9b1 tempest-ProjectMemberTests-949013298 None] Creating offline snapshot 824ec744-a035-4972-ae20-c0dc755c0429 of volume 86eb32a5-122d-478d-9f52-0a81bb77f9aa {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:55:52 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[8326daef-39d6-4fae-b137-d89540d6424a]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec23ccb0-6442-4ba9-a6fd-0eade772f9b1 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:52 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa Jul 24 09:55:52 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:53 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec23ccb0-6442-4ba9-a6fd-0eade772f9b1 tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa" returned: 0 in 0.342s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec23ccb0-6442-4ba9-a6fd-0eade772f9b1 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.824ec744-a035-4972-ae20-c0dc755c0429 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:53 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.824ec744-a035-4972-ae20-c0dc755c0429 1G Jul 24 09:55:53 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:53 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec23ccb0-6442-4ba9-a6fd-0eade772f9b1 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.824ec744-a035-4972-ae20-c0dc755c0429 1G" returned: 0 in 0.404s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec23ccb0-6442-4ba9-a6fd-0eade772f9b1 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.824ec744-a035-4972-ae20-c0dc755c0429 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:53 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.824ec744-a035-4972-ae20-c0dc755c0429 Jul 24 09:55:53 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:53 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec23ccb0-6442-4ba9-a6fd-0eade772f9b1 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.824ec744-a035-4972-ae20-c0dc755c0429" returned: 0 in 0.299s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:53 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-ec23ccb0-6442-4ba9-a6fd-0eade772f9b1 tempest-ProjectMemberTests-949013298 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.824ec744-a035-4972-ae20-c0dc755c0429 is being set with open permissions: ugo+rw Jul 24 09:55:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec23ccb0-6442-4ba9-a6fd-0eade772f9b1 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.824ec744-a035-4972-ae20-c0dc755c0429 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:53 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.824ec744-a035-4972-ae20-c0dc755c0429 Jul 24 09:55:53 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:54 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec23ccb0-6442-4ba9-a6fd-0eade772f9b1 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.824ec744-a035-4972-ae20-c0dc755c0429" returned: 0 in 0.257s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec23ccb0-6442-4ba9-a6fd-0eade772f9b1 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:54 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.info Jul 24 09:55:54 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:54 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec23ccb0-6442-4ba9-a6fd-0eade772f9b1 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.info" returned: 0 in 0.252s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:54 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-ec23ccb0-6442-4ba9-a6fd-0eade772f9b1 tempest-ProjectMemberTests-949013298 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.info is being set with open permissions: ugo+rw Jul 24 09:55:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec23ccb0-6442-4ba9-a6fd-0eade772f9b1 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:54 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.info Jul 24 09:55:54 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:54 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-ec23ccb0-6442-4ba9-a6fd-0eade772f9b1 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.info" returned: 0 in 0.244s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-ec23ccb0-6442-4ba9-a6fd-0eade772f9b1 tempest-ProjectMemberTests-949013298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.878s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:54 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-ec23ccb0-6442-4ba9-a6fd-0eade772f9b1 tempest-ProjectMemberTests-949013298 None] Create snapshot completed successfully Jul 24 09:55:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-824ec744-a035-4972-ae20-c0dc755c0429-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] Lock "cinder-824ec744-a035-4972-ae20-c0dc755c0429-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-86eb32a5-122d-478d-9f52-0a81bb77f9aa" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-86eb32a5-122d-478d-9f52-0a81bb77f9aa" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-824ec744-a035-4972-ae20-c0dc755c0429" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-824ec744-a035-4972-ae20-c0dc755c0429" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] Deleting offline snapshot 824ec744-a035-4972-ae20-c0dc755c0429 of volume 86eb32a5-122d-478d-9f52-0a81bb77f9aa {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:55:54 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] snapshot_file for this snap is: volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.824ec744-a035-4972-ae20-c0dc755c0429 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:55:54 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd37de0-402e-42f5-b407-28ffe5f030a6]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.824ec744-a035-4972-ae20-c0dc755c0429 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:55 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.824ec744-a035-4972-ae20-c0dc755c0429 Jul 24 09:55:55 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:55 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.824ec744-a035-4972-ae20-c0dc755c0429" returned: 0 in 0.382s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:55 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:55:55 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6c7cfb-cf6e-4277-9ca6-adf5cf7b65a7]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:55 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa Jul 24 09:55:55 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:55 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa" returned: 0 in 0.377s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:55 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.824ec744-a035-4972-ae20-c0dc755c0429 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:55 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.824ec744-a035-4972-ae20-c0dc755c0429 Jul 24 09:55:55 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:56 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.824ec744-a035-4972-ae20-c0dc755c0429" returned: 0 in 0.362s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.824ec744-a035-4972-ae20-c0dc755c0429 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:56 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.824ec744-a035-4972-ae20-c0dc755c0429 Jul 24 09:55:56 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:56 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:56 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa.824ec744-a035-4972-ae20-c0dc755c0429" returned: 0 in 0.260s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-824ec744-a035-4972-ae20-c0dc755c0429" released by "_delete_snapshot" :: held 1.495s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-86eb32a5-122d-478d-9f52-0a81bb77f9aa" released by "delete_snapshot" :: held 1.519s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:56 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] Created reservations ['5f222e07-9ebd-40ee-9b8b-abc68752ce6a', 'ee380814-d40e-4439-a286-e65af7702cb7', '53bc596c-1506-42c1-9473-1a757b80c60d', '591ed6a1-8598-4804-a27f-3959287c3a21'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:56 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] Delete snapshot completed successfully. Jul 24 09:55:56 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8f2ffc70-1213-4630-9444-3e94f5592024 tempest-ProjectMemberTests-949013298 None] Lock "cinder-824ec744-a035-4972-ae20-c0dc755c0429-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a37f97bb-c0bb-4a56-ae02-b109c019db92 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-86eb32a5-122d-478d-9f52-0a81bb77f9aa-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a37f97bb-c0bb-4a56-ae02-b109c019db92 tempest-ProjectMemberTests-949013298 None] Lock "cinder-86eb32a5-122d-478d-9f52-0a81bb77f9aa-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a37f97bb-c0bb-4a56-ae02-b109c019db92 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-86eb32a5-122d-478d-9f52-0a81bb77f9aa" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:55:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a37f97bb-c0bb-4a56-ae02-b109c019db92 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-86eb32a5-122d-478d-9f52-0a81bb77f9aa" acquired by "delete_volume" :: waited 0.019s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:55:57 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[755f13a5-ab61-4964-8f5d-6bead0f80f57]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:55:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a37f97bb-c0bb-4a56-ae02-b109c019db92 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:57 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa Jul 24 09:55:57 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:57 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a37f97bb-c0bb-4a56-ae02-b109c019db92 tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa" returned: 0 in 0.385s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a37f97bb-c0bb-4a56-ae02-b109c019db92 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:57 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa Jul 24 09:55:57 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:57 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a37f97bb-c0bb-4a56-ae02-b109c019db92 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-86eb32a5-122d-478d-9f52-0a81bb77f9aa" returned: 0 in 0.249s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:57 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a37f97bb-c0bb-4a56-ae02-b109c019db92 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-86eb32a5-122d-478d-9f52-0a81bb77f9aa" released by "delete_volume" :: held 0.693s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:57 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=261,cinder:SELECT=199,cinder:INSERT=74,cinder:DELETE=21 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:55:57 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-a37f97bb-c0bb-4a56-ae02-b109c019db92 tempest-ProjectMemberTests-949013298 None] Created reservations ['e835232e-b4db-4b86-a0fc-51ef66c47521', '2db34d8d-e7b1-4e38-86e2-f80109c604ea', '72d21520-70cd-49aa-a906-ee63d25f77fe', '1802edfc-dae3-4450-8771-c04dcf97387e'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:55:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a37f97bb-c0bb-4a56-ae02-b109c019db92 tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a37f97bb-c0bb-4a56-ae02-b109c019db92 tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:57 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a37f97bb-c0bb-4a56-ae02-b109c019db92 tempest-ProjectMemberTests-949013298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:57 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-a37f97bb-c0bb-4a56-ae02-b109c019db92 tempest-ProjectMemberTests-949013298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-a37f97bb-c0bb-4a56-ae02-b109c019db92 tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:57 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a37f97bb-c0bb-4a56-ae02-b109c019db92 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:57 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:55:57 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:58 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-a37f97bb-c0bb-4a56-ae02-b109c019db92 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.269s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-a37f97bb-c0bb-4a56-ae02-b109c019db92 tempest-ProjectMemberTests-949013298 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:55:58 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-a37f97bb-c0bb-4a56-ae02-b109c019db92 tempest-ProjectMemberTests-949013298 None] Deleted volume successfully. Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-a37f97bb-c0bb-4a56-ae02-b109c019db92 tempest-ProjectMemberTests-949013298 None] Lock "cinder-86eb32a5-122d-478d-9f52-0a81bb77f9aa-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Flow 'volume_create_manager' (e04c5f59-8e54-4655-b76e-fd9944c3554e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3242a6-5b47-4b78-878c-c3792c155e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=265,cinder:DELETE=23,cinder:SELECT=202,cinder:INSERT=68 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3242a6-5b47-4b78-878c-c3792c155e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1147217129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3bf278-e01a-46e5-9d62-cff38c89485c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b587ba61104b63b86e5a657e21be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:59Z,use_quota=True,user_id='bb693ea0a87140e195a91cab5d5e34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad649312-3a57-4839-98f8-75fb421229b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad649312-3a57-4839-98f8-75fb421229b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547247d2-16e0-4f67-958f-30dc29df0a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547247d2-16e0-4f67-958f-30dc29df0a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c3bf278-e01a-46e5-9d62-cff38c89485c', 'volume_name': 'volume-9c3bf278-e01a-46e5-9d62-cff38c89485c', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7548af0d-8848-48c2-8e6a-4e67e3ac9cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7548af0d-8848-48c2-8e6a-4e67e3ac9cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ad9a76-c3f2-4f32-8338-eacaedb6d422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:58 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Volume 9c3bf278-e01a-46e5-9d62-cff38c89485c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c3bf278-e01a-46e5-9d62-cff38c89485c', 'volume_size': 1} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1147217129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3bf278-e01a-46e5-9d62-cff38c89485c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b587ba61104b63b86e5a657e21be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:55:59Z,use_quota=True,user_id='bb693ea0a87140e195a91cab5d5e34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Creating volume 9c3bf278-e01a-46e5-9d62-cff38c89485c {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:55:58 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:55:58 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:58 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c 1073741824 Jul 24 09:55:58 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:59 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c 1073741824" returned: 0 in 0.444s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:55:59 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c Jul 24 09:55:59 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:55:59 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Jul 24 09:55:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c" returned: 0 in 0.277s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:55:59 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:55:59 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:55:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ad9a76-c3f2-4f32-8338-eacaedb6d422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3bf278-e01a-46e5-9d62-cff38c89485c', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5c535f-a1ea-4f5e-890e-9f58af2a67f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:55:59 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Volume volume-9c3bf278-e01a-46e5-9d62-cff38c89485c (9c3bf278-e01a-46e5-9d62-cff38c89485c): created successfully Jul 24 09:55:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5c535f-a1ea-4f5e-890e-9f58af2a67f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:55:59 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Flow 'volume_create_manager' (e04c5f59-8e54-4655-b76e-fd9944c3554e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:55:59 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-d9d9e758-a339-4668-8005-851ae7418d8a tempest-ProjectMemberTests-949013298 None] Created volume successfully. Jul 24 09:56:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4925a40b-c8c0-4518-8984-fb680cec6418 tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:56:00 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4925a40b-c8c0-4518-8984-fb680cec6418 tempest-ProjectMemberTests-949013298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:56:00 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-4925a40b-c8c0-4518-8984-fb680cec6418 tempest-ProjectMemberTests-949013298 None] Creating offline snapshot e165281a-e6e2-4dc0-90a3-799ea74d5071 of volume 9c3bf278-e01a-46e5-9d62-cff38c89485c {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:56:01 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[08574e51-d77b-4eac-80b2-a789809859fb]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:56:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4925a40b-c8c0-4518-8984-fb680cec6418 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:01 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c Jul 24 09:56:01 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:01 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4925a40b-c8c0-4518-8984-fb680cec6418 tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c" returned: 0 in 0.371s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4925a40b-c8c0-4518-8984-fb680cec6418 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.e165281a-e6e2-4dc0-90a3-799ea74d5071 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:01 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.e165281a-e6e2-4dc0-90a3-799ea74d5071 1G Jul 24 09:56:01 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:01 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4925a40b-c8c0-4518-8984-fb680cec6418 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.e165281a-e6e2-4dc0-90a3-799ea74d5071 1G" returned: 0 in 0.392s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:01 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4925a40b-c8c0-4518-8984-fb680cec6418 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c3bf278-e01a-46e5-9d62-cff38c89485c -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.e165281a-e6e2-4dc0-90a3-799ea74d5071 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:01 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c3bf278-e01a-46e5-9d62-cff38c89485c -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.e165281a-e6e2-4dc0-90a3-799ea74d5071 Jul 24 09:56:01 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:02 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4925a40b-c8c0-4518-8984-fb680cec6418 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c3bf278-e01a-46e5-9d62-cff38c89485c -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.e165281a-e6e2-4dc0-90a3-799ea74d5071" returned: 0 in 0.280s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:02 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-4925a40b-c8c0-4518-8984-fb680cec6418 tempest-ProjectMemberTests-949013298 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.e165281a-e6e2-4dc0-90a3-799ea74d5071 is being set with open permissions: ugo+rw Jul 24 09:56:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4925a40b-c8c0-4518-8984-fb680cec6418 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.e165281a-e6e2-4dc0-90a3-799ea74d5071 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:02 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.e165281a-e6e2-4dc0-90a3-799ea74d5071 Jul 24 09:56:02 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:02 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4925a40b-c8c0-4518-8984-fb680cec6418 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.e165281a-e6e2-4dc0-90a3-799ea74d5071" returned: 0 in 0.247s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4925a40b-c8c0-4518-8984-fb680cec6418 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:02 devstack sudo[108444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.info Jul 24 09:56:02 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:02 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4925a40b-c8c0-4518-8984-fb680cec6418 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.info" returned: 0 in 0.239s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:02 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-4925a40b-c8c0-4518-8984-fb680cec6418 tempest-ProjectMemberTests-949013298 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.info is being set with open permissions: ugo+rw Jul 24 09:56:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4925a40b-c8c0-4518-8984-fb680cec6418 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:02 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.info Jul 24 09:56:02 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:02 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-4925a40b-c8c0-4518-8984-fb680cec6418 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.info" returned: 0 in 0.235s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:02 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-4925a40b-c8c0-4518-8984-fb680cec6418 tempest-ProjectMemberTests-949013298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:56:02 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-4925a40b-c8c0-4518-8984-fb680cec6418 tempest-ProjectMemberTests-949013298 None] Create snapshot completed successfully Jul 24 09:56:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-e165281a-e6e2-4dc0-90a3-799ea74d5071-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:56:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] Lock "cinder-e165281a-e6e2-4dc0-90a3-799ea74d5071-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:56:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-9c3bf278-e01a-46e5-9d62-cff38c89485c" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:56:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-9c3bf278-e01a-46e5-9d62-cff38c89485c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:56:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-e165281a-e6e2-4dc0-90a3-799ea74d5071" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:56:03 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-e165281a-e6e2-4dc0-90a3-799ea74d5071" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:56:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] Deleting offline snapshot e165281a-e6e2-4dc0-90a3-799ea74d5071 of volume 9c3bf278-e01a-46e5-9d62-cff38c89485c {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:56:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] snapshot_file for this snap is: volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.e165281a-e6e2-4dc0-90a3-799ea74d5071 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:56:03 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[807d519c-418f-431b-a67d-90b35ef6380f]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:56:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.e165281a-e6e2-4dc0-90a3-799ea74d5071 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:03 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.e165281a-e6e2-4dc0-90a3-799ea74d5071 Jul 24 09:56:03 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:03 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.e165281a-e6e2-4dc0-90a3-799ea74d5071" returned: 0 in 0.347s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:03 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c3bf278-e01a-46e5-9d62-cff38c89485c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:56:03 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[473d9289-fdd3-4883-b273-def0c864e2df]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:56:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:03 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c Jul 24 09:56:03 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:03 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c" returned: 0 in 0.334s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:03 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.e165281a-e6e2-4dc0-90a3-799ea74d5071 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:03 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.e165281a-e6e2-4dc0-90a3-799ea74d5071 Jul 24 09:56:03 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:04 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.e165281a-e6e2-4dc0-90a3-799ea74d5071" returned: 0 in 0.331s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.e165281a-e6e2-4dc0-90a3-799ea74d5071 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:04 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.e165281a-e6e2-4dc0-90a3-799ea74d5071 Jul 24 09:56:04 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:04 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:04 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c.e165281a-e6e2-4dc0-90a3-799ea74d5071" returned: 0 in 0.240s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-e165281a-e6e2-4dc0-90a3-799ea74d5071" released by "_delete_snapshot" :: held 1.339s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:56:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-9c3bf278-e01a-46e5-9d62-cff38c89485c" released by "delete_snapshot" :: held 1.362s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:56:04 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] Created reservations ['3f229e06-cb07-4377-ae36-51c0f921b6d9', 'a5cab91b-bbb8-47df-813e-0c44718d87a8', 'cff637f5-8115-4fb0-8968-d39c3745f666', 'a2e5d538-81c6-410c-926d-fec699476c65'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:56:04 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] Delete snapshot completed successfully. Jul 24 09:56:04 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-06deb3d9-6e50-4e1f-ace7-89500a09b172 tempest-ProjectMemberTests-949013298 None] Lock "cinder-e165281a-e6e2-4dc0-90a3-799ea74d5071-delete_snapshot" released by "delete_snapshot" :: held 1.481s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:56:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-abd26499-12df-4ead-bacf-7b22376af24d tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-9c3bf278-e01a-46e5-9d62-cff38c89485c-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:56:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-abd26499-12df-4ead-bacf-7b22376af24d tempest-ProjectMemberTests-949013298 None] Lock "cinder-9c3bf278-e01a-46e5-9d62-cff38c89485c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:56:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-abd26499-12df-4ead-bacf-7b22376af24d tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-9c3bf278-e01a-46e5-9d62-cff38c89485c" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:56:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-abd26499-12df-4ead-bacf-7b22376af24d tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-9c3bf278-e01a-46e5-9d62-cff38c89485c" acquired by "delete_volume" :: waited 0.016s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:56:05 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c6034c-ae01-4d95-ac87-c9251ba133cc]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:56:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-abd26499-12df-4ead-bacf-7b22376af24d tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:05 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c Jul 24 09:56:05 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:05 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-abd26499-12df-4ead-bacf-7b22376af24d tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c" returned: 0 in 0.342s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-abd26499-12df-4ead-bacf-7b22376af24d tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:05 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c Jul 24 09:56:05 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:05 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:05 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-abd26499-12df-4ead-bacf-7b22376af24d tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-9c3bf278-e01a-46e5-9d62-cff38c89485c" returned: 0 in 0.245s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:05 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-abd26499-12df-4ead-bacf-7b22376af24d tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-9c3bf278-e01a-46e5-9d62-cff38c89485c" released by "delete_volume" :: held 0.642s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-abd26499-12df-4ead-bacf-7b22376af24d tempest-ProjectMemberTests-949013298 None] Created reservations ['74c9b04d-d448-4152-ab90-27a1fd96bde5', 'ee49ae7f-1076-4046-8345-b73f76722506', '08e78d08-12d6-4846-999e-0894d25eb4f2', '8f33effc-6c3e-43ec-8b8c-a15a367a63fa'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-abd26499-12df-4ead-bacf-7b22376af24d tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-abd26499-12df-4ead-bacf-7b22376af24d tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-abd26499-12df-4ead-bacf-7b22376af24d tempest-ProjectMemberTests-949013298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-abd26499-12df-4ead-bacf-7b22376af24d tempest-ProjectMemberTests-949013298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-abd26499-12df-4ead-bacf-7b22376af24d tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-abd26499-12df-4ead-bacf-7b22376af24d tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:06 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:56:06 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:06 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-abd26499-12df-4ead-bacf-7b22376af24d tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.234s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-abd26499-12df-4ead-bacf-7b22376af24d tempest-ProjectMemberTests-949013298 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:56:06 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-abd26499-12df-4ead-bacf-7b22376af24d tempest-ProjectMemberTests-949013298 None] Deleted volume successfully. Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-abd26499-12df-4ead-bacf-7b22376af24d tempest-ProjectMemberTests-949013298 None] Lock "cinder-9c3bf278-e01a-46e5-9d62-cff38c89485c-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Flow 'volume_create_manager' (7e1b6cb7-1339-42bd-82d8-7099dd46b3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39faa8ad-337f-427f-93d0-4cca5090c7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39faa8ad-337f-427f-93d0-4cca5090c7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1715422948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5989187c-acd5-43ed-b1f8-294195fe5c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b587ba61104b63b86e5a657e21be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:56:07Z,use_quota=True,user_id='bb693ea0a87140e195a91cab5d5e34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a081ba8b-0c01-4cd4-8971-5f3ed66145c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a081ba8b-0c01-4cd4-8971-5f3ed66145c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5fce367-3fa5-4f00-ab0e-2c414163e081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5fce367-3fa5-4f00-ab0e-2c414163e081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5989187c-acd5-43ed-b1f8-294195fe5c00', 'volume_name': 'volume-5989187c-acd5-43ed-b1f8-294195fe5c00', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129f594f-3327-43b2-8be0-8a43bf5e0018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129f594f-3327-43b2-8be0-8a43bf5e0018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b08cca-1155-4860-be5c-8e1bf4bc221a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:56:06 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Volume 5989187c-acd5-43ed-b1f8-294195fe5c00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5989187c-acd5-43ed-b1f8-294195fe5c00', 'volume_size': 1} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1715422948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5989187c-acd5-43ed-b1f8-294195fe5c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b587ba61104b63b86e5a657e21be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:56:07Z,use_quota=True,user_id='bb693ea0a87140e195a91cab5d5e34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Creating volume 5989187c-acd5-43ed-b1f8-294195fe5c00 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:56:06 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:56:06 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:06 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00 1073741824 Jul 24 09:56:06 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:07 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00 1073741824" returned: 0 in 0.415s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:07 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00 Jul 24 09:56:07 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:07 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00" returned: 0 in 0.240s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:07 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:56:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:56:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b08cca-1155-4860-be5c-8e1bf4bc221a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5989187c-acd5-43ed-b1f8-294195fe5c00', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:56:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e5d8e1-0e4f-4d89-ba30-22fecf335f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:56:07 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Volume volume-5989187c-acd5-43ed-b1f8-294195fe5c00 (5989187c-acd5-43ed-b1f8-294195fe5c00): created successfully Jul 24 09:56:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e5d8e1-0e4f-4d89-ba30-22fecf335f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:56:07 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Flow 'volume_create_manager' (7e1b6cb7-1339-42bd-82d8-7099dd46b3d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:56:07 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-105e5b67-a8a4-486c-9073-58fda423638f tempest-ProjectMemberTests-949013298 None] Created volume successfully. Jul 24 09:56:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0782033d-98fd-4235-aa14-c512bb91429c tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:56:07 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0782033d-98fd-4235-aa14-c512bb91429c tempest-ProjectMemberTests-949013298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:56:08 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-0782033d-98fd-4235-aa14-c512bb91429c tempest-ProjectMemberTests-949013298 None] Creating offline snapshot 5332f15e-f44f-4d60-84d8-19e8fa3f4483 of volume 5989187c-acd5-43ed-b1f8-294195fe5c00 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:56:08 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b42b84-7e1f-498a-a48f-a79c6c2c0fe8]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:56:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0782033d-98fd-4235-aa14-c512bb91429c tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:08 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00 Jul 24 09:56:08 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:08 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0782033d-98fd-4235-aa14-c512bb91429c tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00" returned: 0 in 0.350s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0782033d-98fd-4235-aa14-c512bb91429c tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.5332f15e-f44f-4d60-84d8-19e8fa3f4483 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:08 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.5332f15e-f44f-4d60-84d8-19e8fa3f4483 1G Jul 24 09:56:08 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:08 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0782033d-98fd-4235-aa14-c512bb91429c tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.5332f15e-f44f-4d60-84d8-19e8fa3f4483 1G" returned: 0 in 0.380s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:08 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0782033d-98fd-4235-aa14-c512bb91429c tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5989187c-acd5-43ed-b1f8-294195fe5c00 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.5332f15e-f44f-4d60-84d8-19e8fa3f4483 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:08 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5989187c-acd5-43ed-b1f8-294195fe5c00 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.5332f15e-f44f-4d60-84d8-19e8fa3f4483 Jul 24 09:56:08 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:09 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0782033d-98fd-4235-aa14-c512bb91429c tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5989187c-acd5-43ed-b1f8-294195fe5c00 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.5332f15e-f44f-4d60-84d8-19e8fa3f4483" returned: 0 in 0.289s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:09 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-0782033d-98fd-4235-aa14-c512bb91429c tempest-ProjectMemberTests-949013298 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.5332f15e-f44f-4d60-84d8-19e8fa3f4483 is being set with open permissions: ugo+rw Jul 24 09:56:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0782033d-98fd-4235-aa14-c512bb91429c tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.5332f15e-f44f-4d60-84d8-19e8fa3f4483 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:09 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.5332f15e-f44f-4d60-84d8-19e8fa3f4483 Jul 24 09:56:09 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:09 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0782033d-98fd-4235-aa14-c512bb91429c tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.5332f15e-f44f-4d60-84d8-19e8fa3f4483" returned: 0 in 0.243s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0782033d-98fd-4235-aa14-c512bb91429c tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:09 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.info Jul 24 09:56:09 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:09 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0782033d-98fd-4235-aa14-c512bb91429c tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.info" returned: 0 in 0.251s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:09 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-0782033d-98fd-4235-aa14-c512bb91429c tempest-ProjectMemberTests-949013298 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.info is being set with open permissions: ugo+rw Jul 24 09:56:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0782033d-98fd-4235-aa14-c512bb91429c tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:09 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.info Jul 24 09:56:09 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:09 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0782033d-98fd-4235-aa14-c512bb91429c tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.info" returned: 0 in 0.236s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:09 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-0782033d-98fd-4235-aa14-c512bb91429c tempest-ProjectMemberTests-949013298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.824s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:56:09 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-0782033d-98fd-4235-aa14-c512bb91429c tempest-ProjectMemberTests-949013298 None] Create snapshot completed successfully Jul 24 09:56:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-5332f15e-f44f-4d60-84d8-19e8fa3f4483-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:56:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] Lock "cinder-5332f15e-f44f-4d60-84d8-19e8fa3f4483-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:56:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-5989187c-acd5-43ed-b1f8-294195fe5c00" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:56:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-5989187c-acd5-43ed-b1f8-294195fe5c00" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:56:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-5332f15e-f44f-4d60-84d8-19e8fa3f4483" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:56:10 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-5332f15e-f44f-4d60-84d8-19e8fa3f4483" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:56:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] Deleting offline snapshot 5332f15e-f44f-4d60-84d8-19e8fa3f4483 of volume 5989187c-acd5-43ed-b1f8-294195fe5c00 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:56:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] snapshot_file for this snap is: volume-5989187c-acd5-43ed-b1f8-294195fe5c00.5332f15e-f44f-4d60-84d8-19e8fa3f4483 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:56:10 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[c210ff03-984f-4ab9-ba90-555dd2b9550f]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:56:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.5332f15e-f44f-4d60-84d8-19e8fa3f4483 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:10 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.5332f15e-f44f-4d60-84d8-19e8fa3f4483 Jul 24 09:56:10 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:10 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.5332f15e-f44f-4d60-84d8-19e8fa3f4483" returned: 0 in 0.372s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:10 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5989187c-acd5-43ed-b1f8-294195fe5c00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:56:10 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2a5ff2-13a5-431b-923f-288c9c28ea4f]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:56:10 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:10 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00 Jul 24 09:56:10 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:11 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00" returned: 0 in 0.356s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.5332f15e-f44f-4d60-84d8-19e8fa3f4483 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:11 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.5332f15e-f44f-4d60-84d8-19e8fa3f4483 Jul 24 09:56:11 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:11 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.5332f15e-f44f-4d60-84d8-19e8fa3f4483" returned: 0 in 0.317s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.5332f15e-f44f-4d60-84d8-19e8fa3f4483 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:11 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.5332f15e-f44f-4d60-84d8-19e8fa3f4483 Jul 24 09:56:11 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:11 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:11 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00.5332f15e-f44f-4d60-84d8-19e8fa3f4483" returned: 0 in 0.232s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-5332f15e-f44f-4d60-84d8-19e8fa3f4483" released by "_delete_snapshot" :: held 1.365s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:56:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-5989187c-acd5-43ed-b1f8-294195fe5c00" released by "delete_snapshot" :: held 1.385s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:56:11 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] Created reservations ['d8b10881-8e1e-4ce0-88af-6d922aec985b', '3294feec-ee2b-4ffb-8ac7-9c52af2f96a6', 'd34d506d-ab8e-486e-a821-b759ba874d42', '9b4c410d-8aa5-4c14-b4fb-73b64a1b9090'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:56:11 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] Delete snapshot completed successfully. Jul 24 09:56:11 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-0411bdd8-4271-42c6-9003-707fa3df1854 tempest-ProjectMemberTests-949013298 None] Lock "cinder-5332f15e-f44f-4d60-84d8-19e8fa3f4483-delete_snapshot" released by "delete_snapshot" :: held 1.514s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:56:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-aee40bac-227f-479e-be2e-85cee8fb2572 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-5989187c-acd5-43ed-b1f8-294195fe5c00-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:56:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-aee40bac-227f-479e-be2e-85cee8fb2572 tempest-ProjectMemberTests-949013298 None] Lock "cinder-5989187c-acd5-43ed-b1f8-294195fe5c00-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:56:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-aee40bac-227f-479e-be2e-85cee8fb2572 tempest-ProjectMemberTests-949013298 None] Acquiring lock "cinder-quobyte-5989187c-acd5-43ed-b1f8-294195fe5c00" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:56:12 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-aee40bac-227f-479e-be2e-85cee8fb2572 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-5989187c-acd5-43ed-b1f8-294195fe5c00" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:56:12 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[651a51bf-c519-4349-aed0-303b9f1d3887]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:56:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aee40bac-227f-479e-be2e-85cee8fb2572 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:12 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00 Jul 24 09:56:12 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:12 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aee40bac-227f-479e-be2e-85cee8fb2572 tempest-ProjectMemberTests-949013298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00" returned: 0 in 0.345s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:12 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aee40bac-227f-479e-be2e-85cee8fb2572 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:12 devstack sudo[108536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00 Jul 24 09:56:12 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:13 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aee40bac-227f-479e-be2e-85cee8fb2572 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-5989187c-acd5-43ed-b1f8-294195fe5c00" returned: 0 in 0.243s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-aee40bac-227f-479e-be2e-85cee8fb2572 tempest-ProjectMemberTests-949013298 None] Lock "cinder-quobyte-5989187c-acd5-43ed-b1f8-294195fe5c00" released by "delete_volume" :: held 0.645s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:56:13 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-aee40bac-227f-479e-be2e-85cee8fb2572 tempest-ProjectMemberTests-949013298 None] Created reservations ['1b78dea1-3de7-494f-8d23-32c87e2a673f', 'b237b792-bf99-4c82-af5e-b21c2d684b1b', 'f4d94d4b-944c-4932-825d-de73c99dc953', '69ff9771-6168-4b3b-b9ba-8634d698ff0e'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:56:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-aee40bac-227f-479e-be2e-85cee8fb2572 tempest-ProjectMemberTests-949013298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:56:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-aee40bac-227f-479e-be2e-85cee8fb2572 tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:56:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-aee40bac-227f-479e-be2e-85cee8fb2572 tempest-ProjectMemberTests-949013298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:56:13 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-aee40bac-227f-479e-be2e-85cee8fb2572 tempest-ProjectMemberTests-949013298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:56:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-aee40bac-227f-479e-be2e-85cee8fb2572 tempest-ProjectMemberTests-949013298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:56:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aee40bac-227f-479e-be2e-85cee8fb2572 tempest-ProjectMemberTests-949013298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:13 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:56:13 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:13 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:13 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-aee40bac-227f-479e-be2e-85cee8fb2572 tempest-ProjectMemberTests-949013298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.243s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:13 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-aee40bac-227f-479e-be2e-85cee8fb2572 tempest-ProjectMemberTests-949013298 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:56:13 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-aee40bac-227f-479e-be2e-85cee8fb2572 tempest-ProjectMemberTests-949013298 None] Deleted volume successfully. Jul 24 09:56:13 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-aee40bac-227f-479e-be2e-85cee8fb2572 tempest-ProjectMemberTests-949013298 None] Lock "cinder-5989187c-acd5-43ed-b1f8-294195fe5c00-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:56:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:56:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:56:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:56:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:56:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:56:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:56:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:15 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:56:15 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:15 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.259s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:56:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:56:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 28 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:56:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:56:23 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=40,cinder:SELECT=28,cinder:DELETE=3,cinder:INSERT=7 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:56:23 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:INSERT=14,cinder:UPDATE=39,cinder:SELECT=28,cinder:DELETE=3 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Flow 'volume_create_manager' (7bc153a0-c7ef-4166-a1b4-1dc9d5562805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4137cb39-8ca8-48b6-953a-8828395f98cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4137cb39-8ca8-48b6-953a-8828395f98cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1204476144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b402e52-2814-4e16-8bab-7db94de51766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34cd8a22f4ec426c94447c84882f3458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:56:39Z,use_quota=True,user_id='bcff13eba99b4701b3ecf0842fe0846f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931a2378-bdfc-46a5-b64c-d6e39e665996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931a2378-bdfc-46a5-b64c-d6e39e665996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9b8117-d241-44fc-b960-68246ea2bd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9b8117-d241-44fc-b960-68246ea2bd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b402e52-2814-4e16-8bab-7db94de51766', 'volume_name': 'volume-3b402e52-2814-4e16-8bab-7db94de51766', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0cfbf8-d7fd-41a5-9748-e0c22066eb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0cfbf8-d7fd-41a5-9748-e0c22066eb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2843fd-0e07-408a-87ce-de00c8288da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:56:39 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Volume 3b402e52-2814-4e16-8bab-7db94de51766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b402e52-2814-4e16-8bab-7db94de51766', 'volume_size': 1} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1204476144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b402e52-2814-4e16-8bab-7db94de51766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34cd8a22f4ec426c94447c84882f3458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:56:39Z,use_quota=True,user_id='bcff13eba99b4701b3ecf0842fe0846f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)}" {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Creating volume 3b402e52-2814-4e16-8bab-7db94de51766 {{(pid=88488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:56:39 devstack cinder-volume[88488]: INFO cinder.volume.drivers.remotefs [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] casted to osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 1073741824 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:39 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 1073741824 Jul 24 09:56:39 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:39 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 1073741824" returned: 0 in 0.403s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:39 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:39 devstack sudo[108598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 Jul 24 09:56:39 devstack sudo[108598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:40 devstack sudo[108598]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766" returned: 0 in 0.240s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'} {{(pid=88488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 09:56:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:56:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2843fd-0e07-408a-87ce-de00c8288da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b402e52-2814-4e16-8bab-7db94de51766', 'volume_size': 1}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:56:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0728268-e250-4cd0-aee8-49eee4a7e9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:56:40 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Volume volume-3b402e52-2814-4e16-8bab-7db94de51766 (3b402e52-2814-4e16-8bab-7db94de51766): created successfully Jul 24 09:56:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0728268-e250-4cd0-aee8-49eee4a7e9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:56:40 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Flow 'volume_create_manager' (7bc153a0-c7ef-4166-a1b4-1dc9d5562805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:56:40 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-e4475d1d-22bf-46e5-867f-8f08ee199424 tempest-SnapshotDependencyTests-577869759 None] Created volume successfully. Jul 24 09:56:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-05c2019b-1337-4f91-9767-89dd0a923267 tempest-SnapshotDependencyTests-577869759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:56:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-05c2019b-1337-4f91-9767-89dd0a923267 tempest-SnapshotDependencyTests-577869759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:56:40 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-05c2019b-1337-4f91-9767-89dd0a923267 tempest-SnapshotDependencyTests-577869759 None] Creating offline snapshot b6b984f2-408f-42c6-bd83-eafa983c70e2 of volume 3b402e52-2814-4e16-8bab-7db94de51766 {{(pid=88488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 09:56:40 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf237e04-6156-4861-9846-4c60e012da42]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:56:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-05c2019b-1337-4f91-9767-89dd0a923267 tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:40 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 Jul 24 09:56:40 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:40 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-05c2019b-1337-4f91-9767-89dd0a923267 tempest-SnapshotDependencyTests-577869759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766" returned: 0 in 0.354s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:40 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-05c2019b-1337-4f91-9767-89dd0a923267 tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2 1G {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:40 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2 1G Jul 24 09:56:40 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:41 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-05c2019b-1337-4f91-9767-89dd0a923267 tempest-SnapshotDependencyTests-577869759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2 1G" returned: 0 in 0.376s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-05c2019b-1337-4f91-9767-89dd0a923267 tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b402e52-2814-4e16-8bab-7db94de51766 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:41 devstack sudo[108612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b402e52-2814-4e16-8bab-7db94de51766 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2 Jul 24 09:56:41 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:41 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-05c2019b-1337-4f91-9767-89dd0a923267 tempest-SnapshotDependencyTests-577869759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b402e52-2814-4e16-8bab-7db94de51766 -F qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2" returned: 0 in 0.295s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:41 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-05c2019b-1337-4f91-9767-89dd0a923267 tempest-SnapshotDependencyTests-577869759 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2 is being set with open permissions: ugo+rw Jul 24 09:56:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-05c2019b-1337-4f91-9767-89dd0a923267 tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:41 devstack sudo[108617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2 Jul 24 09:56:41 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:41 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-05c2019b-1337-4f91-9767-89dd0a923267 tempest-SnapshotDependencyTests-577869759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2" returned: 0 in 0.237s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:41 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-05c2019b-1337-4f91-9767-89dd0a923267 tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:41 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.info Jul 24 09:56:41 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:42 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-05c2019b-1337-4f91-9767-89dd0a923267 tempest-SnapshotDependencyTests-577869759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.info" returned: 0 in 0.241s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:42 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-05c2019b-1337-4f91-9767-89dd0a923267 tempest-SnapshotDependencyTests-577869759 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.info is being set with open permissions: ugo+rw Jul 24 09:56:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-05c2019b-1337-4f91-9767-89dd0a923267 tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.info {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:42 devstack sudo[108623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.info Jul 24 09:56:42 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:42 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-05c2019b-1337-4f91-9767-89dd0a923267 tempest-SnapshotDependencyTests-577869759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.info" returned: 0 in 0.240s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:42 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-05c2019b-1337-4f91-9767-89dd0a923267 tempest-SnapshotDependencyTests-577869759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.822s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:56:42 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-05c2019b-1337-4f91-9767-89dd0a923267 tempest-SnapshotDependencyTests-577869759 None] Create snapshot completed successfully Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.flows.manager.create_volume [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Flow 'volume_create_manager' (dbb1d8c2-e249-4989-bce4-18db9bbc0fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dae5b13-c2a6-4338-8592-fa08a99fdf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dae5b13-c2a6-4338-8592-fa08a99fdf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T07:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c8fb69-6a82-4cb5-869e-98015a0b0895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34cd8a22f4ec426c94447c84882f3458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T07:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b6b984f2-408f-42c6-bd83-eafa983c70e2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T07:56:43Z,use_quota=True,user_id='bcff13eba99b4701b3ecf0842fe0846f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc975a9-a66d-4bba-8444-3a219f3ee067),volume_type_id=edc975a9-a66d-4bba-8444-3a219f3ee067)' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15bd7b6-af99-4fba-8824-b0b5f21c8299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15bd7b6-af99-4fba-8824-b0b5f21c8299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a02aff-d166-4355-bb64-c92e9f026e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a02aff-d166-4355-bb64-c92e9f026e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b9c8fb69-6a82-4cb5-869e-98015a0b0895', 'volume_name': 'volume-b9c8fb69-6a82-4cb5-869e-98015a0b0895', 'volume_size': 1, 'snapshot_id': 'b6b984f2-408f-42c6-bd83-eafa983c70e2'}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af62759-810e-45e4-bd92-a1bfe3be87e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af62759-810e-45e4-bd92-a1bfe3be87e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba4ec06-a1b6-4f6c-9882-f92e4ffbfc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:56:43 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Volume b9c8fb69-6a82-4cb5-869e-98015a0b0895: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b9c8fb69-6a82-4cb5-869e-98015a0b0895', 'volume_size': 1, 'snapshot_id': 'b6b984f2-408f-42c6-bd83-eafa983c70e2'} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Acquiring lock "cinder-quobyte-b6b984f2-408f-42c6-bd83-eafa983c70e2-b9c8fb69-6a82-4cb5-869e-98015a0b0895" by "_create_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Lock "cinder-quobyte-b6b984f2-408f-42c6-bd83-eafa983c70e2-b9c8fb69-6a82-4cb5-869e-98015a0b0895" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Creating volume b9c8fb69-6a82-4cb5-869e-98015a0b0895 from snapshot b6b984f2-408f-42c6-bd83-eafa983c70e2 {{(pid=88488) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Selected osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b as target Quobyte volume. {{(pid=88488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Acquiring lock "cinder-quobyte-b9c8fb69-6a82-4cb5-869e-98015a0b0895" by "_copy_volume_from_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Lock "cinder-quobyte-b9c8fb69-6a82-4cb5-869e-98015a0b0895" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] snapshot: b6b984f2-408f-42c6-bd83-eafa983c70e2, volume: b9c8fb69-6a82-4cb5-869e-98015a0b0895, {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0174e6-b35a-456b-903d-b92eb4403ac3]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:43 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2 Jul 24 09:56:43 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:43 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2" returned: 0 in 0.352s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b402e52-2814-4e16-8bab-7db94de51766(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Creating direct copy from snapshot {{(pid=88488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[581755b3-958a-4d1f-86d7-538ab08f4142]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:43 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 Jul 24 09:56:43 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:43 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766" returned: 0 in 0.340s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG cinder.utils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Path /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b9c8fb69-6a82-4cb5-869e-98015a0b0895 not found in is_blk_device check {{(pid=88488) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 09:56:43 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b9c8fb69-6a82-4cb5-869e-98015a0b0895 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:44 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b9c8fb69-6a82-4cb5-869e-98015a0b0895 Jul 24 09:56:44 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:47 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b9c8fb69-6a82-4cb5-869e-98015a0b0895" returned: 0 in 4.026s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:48 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[62176fa9-1ba5-4e03-bccf-e71a6a1158d6]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:56:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:48 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 Jul 24 09:56:48 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:48 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766" returned: 0 in 0.514s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:48 devstack cinder-volume[88488]: DEBUG cinder.image.image_utils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766, size 1024.00 MB, duration 4.03 sec, destination /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b9c8fb69-6a82-4cb5-869e-98015a0b0895 {{(pid=88488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 09:56:48 devstack cinder-volume[88488]: INFO cinder.image.image_utils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Converted 1024.00 MB image at 254.26 MB/s Jul 24 09:56:48 devstack cinder-volume[88488]: WARNING cinder.volume.drivers.remotefs [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b9c8fb69-6a82-4cb5-869e-98015a0b0895 is being set with open permissions: ugo+rw Jul 24 09:56:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b9c8fb69-6a82-4cb5-869e-98015a0b0895 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:48 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b9c8fb69-6a82-4cb5-869e-98015a0b0895 Jul 24 09:56:48 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:48 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b9c8fb69-6a82-4cb5-869e-98015a0b0895" returned: 0 in 0.235s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Lock "cinder-quobyte-b9c8fb69-6a82-4cb5-869e-98015a0b0895" released by "_copy_volume_from_snapshot" :: held 5.553s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:56:48 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Lock "cinder-quobyte-b6b984f2-408f-42c6-bd83-eafa983c70e2-b9c8fb69-6a82-4cb5-869e-98015a0b0895" released by "_create_volume_from_snapshot" :: held 5.582s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:56:48 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.596s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:56:48 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba4ec06-a1b6-4f6c-9882-f92e4ffbfc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c8fb69-6a82-4cb5-869e-98015a0b0895', 'volume_size': 1, 'snapshot_id': 'b6b984f2-408f-42c6-bd83-eafa983c70e2'}' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:56:48 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9219b99a-9d14-406c-974a-3fb5969dc038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 09:56:48 devstack cinder-volume[88488]: INFO cinder.volume.flows.manager.create_volume [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Volume volume-b9c8fb69-6a82-4cb5-869e-98015a0b0895 (b9c8fb69-6a82-4cb5-869e-98015a0b0895): created successfully Jul 24 09:56:48 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9219b99a-9d14-406c-974a-3fb5969dc038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 09:56:48 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Flow 'volume_create_manager' (dbb1d8c2-e249-4989-bce4-18db9bbc0fd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 09:56:48 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-046853b7-ab7b-43c2-84a0-bd1b97dfe51a tempest-SnapshotDependencyTests-577869759 None] Created volume successfully. Jul 24 09:56:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] Acquiring lock "cinder-b6b984f2-408f-42c6-bd83-eafa983c70e2-delete_snapshot" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:56:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] Lock "cinder-b6b984f2-408f-42c6-bd83-eafa983c70e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:56:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] Acquiring lock "cinder-quobyte-3b402e52-2814-4e16-8bab-7db94de51766" by "delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:56:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] Lock "cinder-quobyte-3b402e52-2814-4e16-8bab-7db94de51766" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:56:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] Acquiring lock "cinder-quobyte-b6b984f2-408f-42c6-bd83-eafa983c70e2" by "_delete_snapshot" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:56:49 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] Lock "cinder-quobyte-b6b984f2-408f-42c6-bd83-eafa983c70e2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:56:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] Deleting offline snapshot b6b984f2-408f-42c6-bd83-eafa983c70e2 of volume 3b402e52-2814-4e16-8bab-7db94de51766 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 09:56:49 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] snapshot_file for this snap is: volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2 {{(pid=88488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 09:56:49 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b992715d-e4e0-423e-9581-ebd010e9d6c3]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:56:49 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:50 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2 Jul 24 09:56:50 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:50 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2" returned: 0 in 0.352s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:50 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.remotefs [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b402e52-2814-4e16-8bab-7db94de51766(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 09:56:50 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a17b54-056d-4da5-9dd7-c60ee648ab02]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:56:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:50 devstack sudo[108663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 Jul 24 09:56:50 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:50 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766" returned: 0 in 0.344s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:50 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2 Jul 24 09:56:50 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:50 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2" returned: 0 in 0.320s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:50 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:50 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2 Jul 24 09:56:50 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:51 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:51 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766.b6b984f2-408f-42c6-bd83-eafa983c70e2" returned: 0 in 0.238s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] Lock "cinder-quobyte-b6b984f2-408f-42c6-bd83-eafa983c70e2" released by "_delete_snapshot" :: held 1.350s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:56:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] Lock "cinder-quobyte-3b402e52-2814-4e16-8bab-7db94de51766" released by "delete_snapshot" :: held 1.372s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:56:51 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] Created reservations ['43d4ac11-f023-42f1-beda-81bd628003b7', '5773891d-898a-4109-9834-1354baf45ba3', 'a2890287-a3c7-4fd9-87ee-ba1577f90ada', '998d1874-6125-49f4-b0f5-a05570fab62e'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:56:51 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] Delete snapshot completed successfully. Jul 24 09:56:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-8edc60c3-ee22-4447-a32d-e173e005ce49 tempest-SnapshotDependencyTests-577869759 None] Lock "cinder-b6b984f2-408f-42c6-bd83-eafa983c70e2-delete_snapshot" released by "delete_snapshot" :: held 1.501s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:56:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-06cf221b-5351-4aaa-bef8-f8b2e4f110a6 tempest-SnapshotDependencyTests-577869759 None] Acquiring lock "cinder-3b402e52-2814-4e16-8bab-7db94de51766-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:56:51 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-06cf221b-5351-4aaa-bef8-f8b2e4f110a6 tempest-SnapshotDependencyTests-577869759 None] Lock "cinder-3b402e52-2814-4e16-8bab-7db94de51766-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:56:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-06cf221b-5351-4aaa-bef8-f8b2e4f110a6 tempest-SnapshotDependencyTests-577869759 None] Acquiring lock "cinder-quobyte-3b402e52-2814-4e16-8bab-7db94de51766" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:56:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-06cf221b-5351-4aaa-bef8-f8b2e4f110a6 tempest-SnapshotDependencyTests-577869759 None] Lock "cinder-quobyte-3b402e52-2814-4e16-8bab-7db94de51766" acquired by "delete_volume" :: waited 0.015s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:56:52 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a17a03-9983-476c-b445-343616caf544]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:56:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06cf221b-5351-4aaa-bef8-f8b2e4f110a6 tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:52 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 Jul 24 09:56:52 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:52 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06cf221b-5351-4aaa-bef8-f8b2e4f110a6 tempest-SnapshotDependencyTests-577869759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766" returned: 0 in 0.353s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06cf221b-5351-4aaa-bef8-f8b2e4f110a6 tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:52 devstack sudo[108681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766 Jul 24 09:56:52 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:52 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06cf221b-5351-4aaa-bef8-f8b2e4f110a6 tempest-SnapshotDependencyTests-577869759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-3b402e52-2814-4e16-8bab-7db94de51766" returned: 0 in 0.237s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:52 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-06cf221b-5351-4aaa-bef8-f8b2e4f110a6 tempest-SnapshotDependencyTests-577869759 None] Lock "cinder-quobyte-3b402e52-2814-4e16-8bab-7db94de51766" released by "delete_volume" :: held 0.647s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:56:52 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-06cf221b-5351-4aaa-bef8-f8b2e4f110a6 tempest-SnapshotDependencyTests-577869759 None] Created reservations ['5740e0d9-7b06-4332-86d8-2c9778938aa7', '318fb0fd-79ef-4d4e-adb1-194f9310f81d', 'e9183262-62fa-411d-9937-be46894e444b', '339ecba4-e69b-4900-89ee-f306d0032833'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:56:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-06cf221b-5351-4aaa-bef8-f8b2e4f110a6 tempest-SnapshotDependencyTests-577869759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:56:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-06cf221b-5351-4aaa-bef8-f8b2e4f110a6 tempest-SnapshotDependencyTests-577869759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:56:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-06cf221b-5351-4aaa-bef8-f8b2e4f110a6 tempest-SnapshotDependencyTests-577869759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:56:52 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-06cf221b-5351-4aaa-bef8-f8b2e4f110a6 tempest-SnapshotDependencyTests-577869759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:56:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-06cf221b-5351-4aaa-bef8-f8b2e4f110a6 tempest-SnapshotDependencyTests-577869759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:56:52 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06cf221b-5351-4aaa-bef8-f8b2e4f110a6 tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:52 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:56:52 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:53 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-06cf221b-5351-4aaa-bef8-f8b2e4f110a6 tempest-SnapshotDependencyTests-577869759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.241s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:53 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-06cf221b-5351-4aaa-bef8-f8b2e4f110a6 tempest-SnapshotDependencyTests-577869759 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:56:53 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-06cf221b-5351-4aaa-bef8-f8b2e4f110a6 tempest-SnapshotDependencyTests-577869759 None] Deleted volume successfully. Jul 24 09:56:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-06cf221b-5351-4aaa-bef8-f8b2e4f110a6 tempest-SnapshotDependencyTests-577869759 None] Lock "cinder-3b402e52-2814-4e16-8bab-7db94de51766-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:56:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dcab9e94-6472-4117-825a-5e6eb26a7fe0 tempest-SnapshotDependencyTests-577869759 None] Acquiring lock "cinder-b9c8fb69-6a82-4cb5-869e-98015a0b0895-delete_volume" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:56:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dcab9e94-6472-4117-825a-5e6eb26a7fe0 tempest-SnapshotDependencyTests-577869759 None] Lock "cinder-b9c8fb69-6a82-4cb5-869e-98015a0b0895-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:56:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dcab9e94-6472-4117-825a-5e6eb26a7fe0 tempest-SnapshotDependencyTests-577869759 None] Acquiring lock "cinder-quobyte-b9c8fb69-6a82-4cb5-869e-98015a0b0895" by "delete_volume" {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 09:56:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dcab9e94-6472-4117-825a-5e6eb26a7fe0 tempest-SnapshotDependencyTests-577869759 None] Lock "cinder-quobyte-b9c8fb69-6a82-4cb5-869e-98015a0b0895" acquired by "delete_volume" :: waited 0.018s {{(pid=88488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 09:56:53 devstack cinder-volume[88488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba42ee16-51e4-43b6-8f21-938add9c7ae6]: (4, 'qcow2') {{(pid=89999) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 09:56:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dcab9e94-6472-4117-825a-5e6eb26a7fe0 tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b9c8fb69-6a82-4cb5-869e-98015a0b0895 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:53 devstack sudo[108688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b9c8fb69-6a82-4cb5-869e-98015a0b0895 Jul 24 09:56:53 devstack sudo[108688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:53 devstack sudo[108688]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dcab9e94-6472-4117-825a-5e6eb26a7fe0 tempest-SnapshotDependencyTests-577869759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b9c8fb69-6a82-4cb5-869e-98015a0b0895" returned: 0 in 0.353s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dcab9e94-6472-4117-825a-5e6eb26a7fe0 tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b9c8fb69-6a82-4cb5-869e-98015a0b0895 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:53 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b9c8fb69-6a82-4cb5-869e-98015a0b0895 Jul 24 09:56:53 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:53 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dcab9e94-6472-4117-825a-5e6eb26a7fe0 tempest-SnapshotDependencyTests-577869759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031/volume-b9c8fb69-6a82-4cb5-869e-98015a0b0895" returned: 0 in 0.245s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:53 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dcab9e94-6472-4117-825a-5e6eb26a7fe0 tempest-SnapshotDependencyTests-577869759 None] Lock "cinder-quobyte-b9c8fb69-6a82-4cb5-869e-98015a0b0895" released by "delete_volume" :: held 0.635s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:56:53 devstack cinder-volume[88488]: DEBUG cinder.quota [None req-dcab9e94-6472-4117-825a-5e6eb26a7fe0 tempest-SnapshotDependencyTests-577869759 None] Created reservations ['dcadf163-cbd9-49b2-9cdd-c08627a2f016', '12f69088-ec80-42fb-ad80-5ee5116741a9', '1c03c293-fb20-4180-ba75-0c4020f0a6d0', '7f8be527-2fc0-4831-b877-cbc6b4a101f3'] {{(pid=88488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 09:56:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-dcab9e94-6472-4117-825a-5e6eb26a7fe0 tempest-SnapshotDependencyTests-577869759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:56:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-dcab9e94-6472-4117-825a-5e6eb26a7fe0 tempest-SnapshotDependencyTests-577869759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:56:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-dcab9e94-6472-4117-825a-5e6eb26a7fe0 tempest-SnapshotDependencyTests-577869759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:56:53 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-dcab9e94-6472-4117-825a-5e6eb26a7fe0 tempest-SnapshotDependencyTests-577869759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:56:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-dcab9e94-6472-4117-825a-5e6eb26a7fe0 tempest-SnapshotDependencyTests-577869759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:56:53 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dcab9e94-6472-4117-825a-5e6eb26a7fe0 tempest-SnapshotDependencyTests-577869759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:56:53 devstack sudo[108696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:56:53 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:56:54 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root Jul 24 09:56:54 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-dcab9e94-6472-4117-825a-5e6eb26a7fe0 tempest-SnapshotDependencyTests-577869759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.234s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:56:54 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-dcab9e94-6472-4117-825a-5e6eb26a7fe0 tempest-SnapshotDependencyTests-577869759 None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:56:54 devstack cinder-volume[88488]: INFO cinder.volume.manager [None req-dcab9e94-6472-4117-825a-5e6eb26a7fe0 tempest-SnapshotDependencyTests-577869759 None] Deleted volume successfully. Jul 24 09:56:54 devstack cinder-volume[88488]: DEBUG cinder.coordination [None req-dcab9e94-6472-4117-825a-5e6eb26a7fe0 tempest-SnapshotDependencyTests-577869759 None] Lock "cinder-b9c8fb69-6a82-4cb5-869e-98015a0b0895-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=88488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 09:57:03 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=27,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=6 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:57:04 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:UPDATE=27,cinder:SELECT=20,cinder:INSERT=8,cinder:DELETE=2 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 09:57:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:57:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 09:57:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 09:57:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b': None} {{(pid=88488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 09:57:15 devstack cinder-volume[88488]: DEBUG cinder.volume.drivers.quobyte [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5faa8a50-05a5-4b08-8383-d9734874ed5b'] {{(pid=88488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 09:57:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.lockutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 09:57:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 09:57:15 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031 Jul 24 09:57:15 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 09:57:15 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Jul 24 09:57:15 devstack cinder-volume[88488]: DEBUG oslo_concurrency.processutils [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c854a86a9cdc79308426c3701abd031" returned: 0 in 0.245s {{(pid=88488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 09:57:15 devstack cinder-volume[88488]: DEBUG cinder.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Notifying Schedulers of capabilities ... {{(pid=88488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 09:57:15 devstack cinder-volume[88488]: DEBUG oslo_service.periodic_task [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] Running periodic task VolumeManager._thread_info {{(pid=88488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 09:57:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread count: 28 {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 09:57:15 devstack cinder-volume[88488]: DEBUG cinder.volume.manager [None req-6db62e0f-3bc4-4981-8b50-f51cb9a55e51 None None] thread info: [<_MainThread(MainThread, started 133255269003392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 09:57:25 devstack cinder-volume[88488]: DEBUG dbcounter [-] [88488] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=88488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}